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testing were essentially identical to t^ie cprrespbnding subtest 
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with adaptive testing was half ia;t refquired with conventional , 
te^tifi^; the shortest adaptive test battery used= 18* of the total 
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covering a different content area. Correlations between subtest scores from 
adaptive and conventional testing were .90 or higher for eleven of the tw&lve 
content areas. An information analysis showed that for all 12 subtests, the 
-subtest ^information curves from adaptive testing were essentially identical to 
the corresponding subtest information curves from conventional testing. On 
^the average, ^the number of items administered with adaptive testing was half 
as many as was^requir.^d with conventional testing; the shortest adaptive test 
battery used 18% of the total number of items in the conventional test, while 
the longest used 80%. The adaptive testing strategy, therefore, provided a 
considerable reduction in test length and virtually ,no loss in precision of ^ 
measurement when compared with the cpnventional administration of the 
achievement test battery. 
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An Adaptive Testing Strategy for Achievement Test Batteries 



Modern test theory (latent trait theory) has provided the *f ramework for < 
a growing body of research in ability measurement through adaptive testing 
Weiss and Betz (1973) have presented a comprehensive review of adaptive testing 
which suggested that adaptive testing can considerably reduce testing time, 
while concurrently yielding scores of ' higher reliability and validity than those 
yielded by ci^nventional tests. During the past several years, a number of 
^studies havel&aen published which were concerned with applications of diff- 
erent adaptive testing strategies in the ability domain (e.g., Betz & Weiss, 
1974,- 1975; Larkit) & Weiss, 1974, 1975; Lord, 1977; McBride & Weiss, 1976; 
Urry, 1977; Vale & Weiss, 1975). Each of these studies, as well as all the pre- 
vious research in adaptive testing (Weiss & Betz, 1973), has been concerned with 
tests which covered only a single content area. Thus, all of the branching pro- 
cedures implemented for the adaptive' selection of items to be administered to 
a testee have br-cn designed exclusively for intra-test branching. That is, items 
were selected within a single, presumably unidimensional, content area. 

Recent studies^ (e. g. , Bejar, Weis3, & Gialluca, 1977; Bejar, Weiss, & Kingsb 
1977) have demonstrated that unidimensional' approaches to intra-test . adapt ive 

testing are useful for measurement in^he achievement domain. Frequently, . 

however, achievement tasts span several content areas. Consequently, in nany 
casfe the assumption of a single dimension may not be appropriate. For these 
kinis of achievement tests, or for achievement test batteries covering a number 
of separable content areas for which separate scores are required, none of the 
existing adaptive strategies described by Weiss (1974) are directly applicable. 

There are two reasons why many of the adaptive testing strategies developed 
for. single-content area ability tests may nox be appropriate for achievement 
tests which cover several content areas. The first reason is that although the 
'unidimensional branching models can be applied to separate content areas, they 
are not designed to take into account the information available between content 
areas. The second, and more practical, reason is that it might not be possible 
to generate relatively large numbers of items, such as those required for many 
adaptive testing strategies, within one content area in an achievement test.^ 
Urry *(1977)' has suggested that item pools to be used in adaptive testing with 
Owen^'s (1975) Bayesiau testing strategy should include ,a minimum of 100 items 
to measure one dimen.oion. Although there are no firm guidelines for other 
^adaptive testing strategies, it is evident that they will function best with 
^ large item pools. Thus, application of these strategies to an achievement test 
battery of five subtests would require the test constructor to assemble 500 
items with good, psychometric qualities. Frequently, this is not possible. 
Consequently, in the application of adaptive testing to the unique problems in^ 
the measurement oj: achievement, an important research issue is the identif icatior 
of adaptive testing strategies which make efficient use of existing item pools, 
rather than requiring the re-design of test item pools to meet the requirements 
of specific adaptive testing strategies. 
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The present paper describes an adaptive testing strategy which can be 
used in achievement tests with relatively sma],l numbers cf items. The strategy 
is. designed for achievement test batteries or achievement tests with multiple 
content areas. It incorpo;rates both intra-subtest branching .and inter-subtest 
branching in order to efficiently adapt the test battery to each individual 
testee« The adaptive testing strategy is applied to a test battery and evaluated 
in terms of: 

1* The reduction *in number of items administered,' 

2. Correlations of ability estimates with those derived from conventional 
administration of the test battery, and 

3. The effects of adaptive administration on the psychometric information 
in the test scores. 



METHOD 
Purpose 

The purpose of this study was to develop and evaluate an efficient and 
generalizable adaptive testing strategy for an achievement test battery com- 
prised of a number of subtests. The adaptive testing strategy developed is 
designed to operate within a fixed item pool containing a relatfvely small nun\ber 
of items for each subtest. Real data simulation techniques (Weiss & Betz, 1973, 
pp. 11-12) were used. That is, the adaptive testing strategy was applied to 
item response data obtained from the administration of an achievement test battery 
which had been previously administered conventionally by paperrand-pencil. 
Results for the conventional testing strategy were compared with those for the 
adaptive testing strategy in terms of both test information and test length. 

• Proaedur*e 
Test Items and Subjects 

r 

Achievement test data were provided by the Personnel and Training Evaluation 
Program (PTEP) of the Naval Guided Missile School at Dam Neck, Virginia. ^ 
These data were from a systems achievement test (SAT, F17603) battery administered 
to 365 fire control technicians. The test battery included twelve subtests, each 
covering knowledge areas for different equipment or subject matter. Table 1 
shows the content and number of items in each subtest. The test battery was 
administered in one booklet containing 232 items. The number of items per sub- 
test» ranged from 10 to 32; all of the items were multiple-choice with four 
response choices. The data provided by PTEP consisted of an identification 
number for each testee, the testee's number correct score on each of the twelve 

subtests", and correct-incorrect item responses for each of the 232 items. 

» ) » 

Item Parameterization 

items werp parameterized using Urry*s ESTEM computer program (*see Urry, 
1976, p. 99) for latent trait item parameterization employing the three-para- 
meter normali ogive model. This program provided estimates of the item discrim- 
inatioi\ (a), item difficulty (fc) , and guessing (a) parameters. The items for 
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^Data were generously supplied by Lieutenant Commander Lee J. Walker of PTEP. 
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Table 1- 

Number of Items in Each Subtest 



No. of 

Subtest Content ^^^"^5 



A 


Fire control system casualty 






procedures 


10 


B 


Optical alignment group 


10 


C 


Control console and power 


18 




subsystem 


D 


Platform positioning equip- 






ment 


22 


E 


Multiplexed equipment 


18 


F 


Digital control computer and 






software 


18 


G 


Digital control computer — 






operator interface 


lA 


H 


Magnetic disk file 


12 


I 


Digital control computer — 


24 




missile interface 


J 


Guidance and guidance testing 


29 


K 


MTRE MKG M0D3 


32 


L 


Spare guidance temperature 






monitor 


25 


Total 




232 



each subtest were parameterized independently of items in other subtests. 

Urry's item parameterization program calculates item parameter estimates 
using a two-phase procedure. In the first phase, initial^ item parameter 
estimates are determined for all items. However, item parameters are not re- 
ported for an item if one or mote of the following conditions holds: 1) a<.80, 
2) fc>-2».00, 3) fc>4.00, or 4) O.30. In the second phase, item parameters are 
recomputed 'for alt items which are not excluded by the criteria applied in 
the first phase. In this phase, item parameter estimates are reported without 
restrictions (e.g., c may be greater than .30 for some items in the second phase) 
for all items not excluded in the first phase. 

Adaj^tive Testing Strategy r 

« 

Tho adaptive testing procedure was developed in order to reduce to a min- 
imum the number of items administered to each individual with as little impact*^ 
as possible upon the measurement characteristics of the test battery. Both 
intra-subtest adaptive branching and inter-subtest adaptive branching were used 
in the development of the procedure. 

Intra-Subtest Branching 

Item selection . The basic concept for intra-subtest adaptive branching 
was that the order in which the items were to be administered was to bejependent 
upon values of the item information curve. as defined by Birnbaum (19687* For 
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each item in each subtest, item information values were computed using 
Equation 1 (Birnbaum, 1968, p. 462): 



I (9) = (1-c )D^a^\i>^[DL (e)]/{i|jDL (e)] + c f (-Z?L (9)]} 

■g . g g 9 9 -9 9 



[11 
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where — 

D » 1*7; this is the scaling factor which maximizes agreement between 
the normal ogive and logistic latent trait models; 

^ = the logistic probability density function; 

V = the cumulative logistic distribution function;^ 

and values fpr the parameters a^y b^^ and o^^ were derived .for each of the 
a items in a subtest from die results of the item parameterization phase. 

the information values for each item, I (6), were computed for values of 6 
ranging from -3,0 to +3.0 in steps of .2 for eaT:h item^ in each subtest. 

Items were selected within a subtest for each cestee by computing the value 
of .all item information curves at the current estimated achievement level (9) 
for that testee using Equation 1. The item selected for administration was the 
item which had the highest information value at the testee 's current level of 
0. Once an item was administered to a testee, it was eliminated from the sub- 



test pool of available items for that testee. 



I 



Estimation of 6 . Owen^'s (1975) Bayesian scoring procedure was used for 
this simulation study. This scoring procedure provides an achievement level 
estimate (6) after each mth test item is administere^d. The procedure begins 
with a prior estimate of 6,„and its variance (a^). For the first item of the 

first subtest ' administered (/?7=1) , these were 0.00 and 1.00, respectively. An 
item is administered and scored as^correct (1) or incorrect (0). For a correct 
response, the revised estimate of 6 is determined by Equation 2, 



m 



m 



0(0) 



o +(l-c )<I>(-D) 
9 9 



[2] 



and^its variance by Equation 3, 



[3] 
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For an incorrect response, the revised estimate of 9 is determined by Equation A, 



= E(9|0) = 6 - 
m+1 ' ■ w 




[A] 



~an^ its variance by Equation 5^ 



' a? = var(e|0) = 0^ 



1 + 



a2a2 
g m' 



(t>(P) \{ HD) 
1 11 ^{D) 



) 



[5] 



In Equations 2 through 5 (adapted from Owen, 1975, p. 353) 
^{D) is the normal probability density function, 

is the cumulative normal distribution function. 



D = 



b - 8 



'[6-1 



A = o + {1-0 ^^{-P) ; and 
^ 9 



a * ib and o are the item parameter 'estimates. 

g g g 

The updated estimates of 6 from either Equations 2 or A, along wit^i the^ir associated 
variances, are used as the prior estimates of 0 for the selection of the ne::t test 
item, which is based on the maximum information rule described ab(j)ve. The next' 
item is administered; and a new value of § is determined, which i$^ then used to 
select the next item- This procedure is repeated until a terminat^ion criterion 
is reached. • 

Termination evitevia . Two criteria were used in determining when administ7 
ration of items within a subtest should be stopped: 1) when all of the remain- 
ing items provided less than a pre-determined small amount of information; or 2) 
when the within-subtest item pool was exhausted. Testing 'was terminated for a 
given testee at the first occurrence of one pf these criteria within a given sub- 
test. In applying the first criterion, two arbitrarily small values of infor- 
maa<Hi were studied; testing was terminated when there was no item available ^ 
which provided an^ Informntion value greater than .01 or .001 at a given testee s 
current love] of 0. • • 

f 
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Figure 1 diagramatically sununjrizes the intra-subtest branching procedure, 
p Appendix A gives aft illustration of this procedure, using six items f roii^Subtest 1. 



Figure 1 
Intra-subtest Branching Scheme 



o 



. CHOOSE INITIAL 9 AND 
MINIMUM INFORMiMION" FOR 
TERMINATION 



SELECT ITEM (NOT 
PREVIOUSLY ADMINISTERED) 
PROVIDING GREATEST 
. INFORl'lATION AT § 



UPDATE e 




NO 



YES 



ADMINISTER AND 
SCORE ITEM 



BRANCH 
TO NEXT 
SUBTEST 



Inter-Subtest Branching . 

Subtest ordering! . The order of administration for the various subtest?; 
was chosen to take maximum advantage jf the intercorrelations among them, tJiereby 
utilizing the redundant inform'htion in previously administered subtests. This 
was accomplished through linear multiple regression. ' First, the number correct 
subtest scores for the twelve subtests were intercorrelated, and the highest, 
bivariate correlation was choseii from the intcrcorrelation matrix. One of the^e 
two subtests was arbitrarily designated to be administered first; the ocher was, 
designated to be administered second. 

Multiple correlations were then computed using the subt^^sts previously 
designated first and second as predictor variables. Each of the ten remaining 
subtests, in turn, was designated as the criterion variable. Of these ten sub- 
tests, the one which had t,he highest multiple correlation with the first and 
second subtests was designated as the third subtest. This procedure was repeated 
to select thf* fourtli subtest for the adaptive administration, computing multiple 
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correlations with the first three subtests as. predictor variables and each 
of the rgjna4ning nine subtests, in tiirn, as the criterion variable. That sub- 
test l^a^fing the highest multiple correlation with the first three subtests was 
selected as the fourth subtest to be administered. By adding one subtest to the 
predictor set at each subsequent stage, this procedure was continued until all * 
twelve subtests were ordered. * ^ 

V As a result of this procedure, the order in vhich the subtests were admin- 
istered was the same for all testees. However, the selection of items within 
each subtest and the order in which those items were administei^ed varied with 
testees as a function of the amount of item information provided at the testee 's 
current achievement estimate. * * 

Diffevenzi,aL subtest entm points* An importanf feature of the adaptive 
testing strategy implemented in this study was that after the first subtest, 
each testee's entry points for the second and subsequent' subtests .were differ- 
entially determined. For the first subtest, each testee's ,achievement level 
was assumed to be 6=0.00. That is, having no previous information on which to 
base an estimate of the testee's achievement level, the initial item chosen from 
the fi^st subtest for administration was the item which .provided the most infor- 
mation for an estimated achievement level at the mean of the 6 distribution. 
Thus,- all testees began the first subtest with the. same test item. 

The entry point into the item pool for the second subtest was determined ^ 
from both the examinee's § at the end of the fir^t 'subtest and the bivariate* 
regression of scores from Subtest 1 on Subtest 2; This regression equation was 
based, not only on scores for the items adifiinistered adaptively, but also on the 
correlations derived from nuT«ber correct scores for all items in each of the 
subtests. The first item to be administered for a testee in the second subtest 
was determined from information provided by evaluating Equation 8. 

where > ' 

is the first 6 used f.or 'selection of the first test item in Subtest^2, 

is the final 6 for a testee at compl'etiqn of the adaptive administration, 
of items in Subtest Jl, ' . * 

jB, 2 the biv^iiate regression coefficient for the regression of Subtest 2 
*^ on Siibtest 1, and * ' * , ' - ^ , 

A is the regression constant. 

The entry achievement level estimate, 6^„-> computed as 6_ by Equations 2 . 

and 4»was used for selecting the first^ item to be administered in Subtest 2. 
The variance of this estimate (a^ in Equations 3 and 5) was determined by ' 

Equation 9, which is the formula for the squared standa*rd error of estimate 
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in-bivairiate regression (adapted from Glass L Stanley, 1970, 143):. 



[9] 



where ^ the subscripts 1 and 2 represent the first and second subtests. 



Determination of the entry point for the thl;rd and subsequent subtests was 
merely a: generalization of the method used for. the second^subtest. The testee^s ^ 
achievement level estimates from Subtest 1 (§. ) and Subtest .2 (6^) were entered in-, 

to the multiple regression equation for predicting Subtest 3 scores from scores ^ 
"'oh^^Siibtests i and ,2. This generated an estimated subtest„ score for an^individual 
(e^!j)» which was used as the initial prior achievement 'level estimate (6 ) for intra- 

br? ^ n _ chlng in Subtes t 3. The squared standard error ofjestimate f rom^ the ^ 
mjiitipie rpprft.q.qtnn nf Subtes t"s~^lr^m:d--^~on-&ubteat ^_ was used as t he initial prior ^ 
variance .(a ) of the Bayesian achievement level estimate for Subtest 37 

illustrates this differential entry point procedure. ^ 



Figure 2 ' 
Estimation of Initial Achievement Level Estimate for Subtest 3 (Q^^) 

From the Multiple Regression of Subtest 1 (8^ and Subtest 2 O'^) 



■r 




Regression Line 



^12 = ^^1 + + ^ 
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The inter-subtest branching degression procedur.e was used for entry into 
each of the remaining subtests. Each subsequent regression equation was 
:based pn-the. achievement estimates from each of the previously administered sub- 
tests* A testee^s achievement level estimates for each subtest, based on the* 
multiple regression of all previous subtests on a new subtest, was used as the 
initial Bayesian prior § for intra-subtest branching within that 'subtest. Item 
selection and scoring vrithin subsequent subtests was then based on the intra- 
subtest branching procedures described earlier. * 

. • ' Convehtional Test ^ 

^ ' • T 

A honventional test was used, for comparison with the adaptive testing strategy 
The. subtests were adminl^stered in the same order for both the conventional* and 
adaptive strategies. In the conventional strategy, all items ^within each sub- 
test-*were administered sequentially, so that all testees took the saijie'items in 
the same, order. Hence, there was rto differential entry for the conventional 
strategy. In, addition, all testees completed all items, which is typical in 
conventional testing. 

In order to facilitate comparTstm~~TrE--r-€&ults_t>u Lth the adapt ive strategy, 

Bayesian scoring was employed for the conventional test. A mean o"f'~~0T0— an4-^a _ 

variance of 1.0 were used as the initial prior achievement estimate ^of the^ 
Bayesian score for each subtest. 



Data Analysis 

The basic question examined in this study was whether the number of items 
administered could be reduced through adaptive testing without significantly 
changing the characteristics of the test scores. The effects of reducing the 
number of items by the adaptive testing item selection procedure were evaluated 
by^ means of ^both a correlational analysis and an information analysis. 

.Correlation Analysis o 

Early. research comparing single test adaptive testing strategies. with 
conventional testing strategies (See Betz & Weiss, 1973, 1974; Larkin & Weiss, 
1974, 1975; Vale & Weiss, 1975; Weiss, 1913) demonstrated that adaptive tests 
resulted -in test scores highly correlated with conventional test scores, even 
though the adaptive tests required substantially ^ewer items. Consequently, in 
the present study Pearson product-moment correlations were computed between sub-, 
test, achievement level estimates (9) from the conventional and adaptive testing 
procedures in order to examine the extent of the rejlationship between the- scores. 
These were computed separately foi: each of the twelve subtests. High correla- 
tions between the scores would suggest that the tests ranked the examinees in 
a similar order along the ^achievement continuum. 

Information Analysis 

Information analyses were conducted in order to compare the adaptive and 
conventional testing strategies as a function of achievement levels. Test in- 
formation values fox different testing strategies at different levels on the 

.14 
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. achievement continuum provide an indication of their relative degree of precision 
♦ of measurement (Birnbaum, 1968). 

* %. ' ' * 

Estimated test- info rmatidn curves were generated separately for each subtest 
for both conventional and 'adaptive testing strategies. In the conventional test- 
ing .strategy, an examinee's subtest information value was computed by summing 
the. item Information values at the examinee's filial estimated achievement level 
(§) for that subtest. An estimated* irifotmation curve was plotted for the total 
.group Q^f examinees from their individual achievement level estimates and cori^es- 
ponding 'information values. •For .a conventional 'te^t fhis-is equivalent to com- 
puting the test information functidn using the^Utem parameters d, b, and c, as 
suggested by Bimbaum (1968, .pp. 454-464).* 

Estimated subtest information curves were generated similarly for the 
'adaptive testing strategy. Thfe estimated value of test information was computed 
at each testee's f inal^achievement estimate for the subtest by summing the infor- 
mation values at that 0.for the particular subset of items administered to that, 
testee. Thus, for both adaptive and conventional testing, each test information 
value was computed at the final value of § for the subtest, based on the infor-j 
mation provided by the items actually administered. . | , 

^1 
u 

i 



RESULTS 



Preliminary Results 



Item varameterizaHon . Table 2 presents means and standard deviations 
for estimates of the latent trait item discrimination (a), difficui,ty (Z?) , and 
guessing (c) parameters for the JLtems in the twelve subtests. Complete distri- 
butions of individual item parameter estimates by subtest are shown in Appendix 
Table B-1. 



Table 2 



Means 


and Standard Deviauions of Normal Ogive Item Discrimination 
Difficulty (Z>) , and Guessing (e) Parameters for 12 Subtests 


(a), 


■'v 

Subtest 


Number 
Avail- 
able 


of Items 
Parame- 
t-erized 




a 


• b 




e 




Mean 


S.D. 


Mean 


S.D. 


Mean 


S.D. 


A 


10 


10 


1.90 




, ■ .06 


1.03 


.5.2 


.11 


B 


10 


10 


2,12 


.86 


.31 


1.29 


.53 


.18 


C 


18 


is 


1.80 


.56 


.54 


1.30 


.55 


.08 


D 


22 


19 


1.60 


.60 


.43 


1,28 


.47 


.08 


E 


18 


17 


1.57 


.65 


.74' 


1.32 


.47 


.10 


F 


18 


18 


1.58 


.43 


1.19 


1.45 


.56 , 


,09 


G 


iz. 


13 


1.98 


.94 


1.20 


1.26 


.52 


i-18 


H 


12 


12 


2.12 


.90 


.84 


1.10 


• .43 


- -.10 


I 


' 24 


22 


1.49 


.59 


.88 


1.36 


.43 


. .10 


J 


29 


23 


1.66 


.57 


1.28 


1.12 


.44 


.14 


K 


32 


24 


1.48 


.61 


.91 


1.39 


.43 


.14 


L 


25 


18 


1.73 


.58 


1.44 


1.34 


.52 


"47 
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From the total item pool of 232 items, item parameter f ti'^^Jf "^'^^ . 
;obtained..for 201 items (87%); Several of the subtests A B F H) dxd not 
lose any. items in the calibration process; the largest loss {lU of the original 
number of items) occurred for Subtest L. . 

Mean item discrimination (a) ranged from 1.48-for Subtest K to 2.12 for 
Subtest S. while mean item difficulty ranged from .06 for Subtest A to 1.44 
fof SuJfe^t L. Mean' estimates for the a parameters of these ^ --^J^^""^^^^^,^^ 

iuUiple choice items were relatively high, ranging from a low of .43 to a high 

.off. 56. 

■Svbtest ordering. Table 3 shows the product-moment intercorrelations among 
subt esf !cores for th e twelve content area subtests used to determine the order 
i -^hich the subtests would be administered in the adaptive ^-^^^ J^^^^^^/^^ 
bivariate correlation (.53) was between content areas C and K, which were desxg 
nated Subtest 1 and Subtest 2, respectively. 



Table 3 

Intercorrela t3\-)ns Among Conte nt Area Scores. 

I- 



B 

C 

D 

E 

F 

G 

H 

I 

J 

K 

L 



36 

37 

30- 

30 

25 

23 

19 

42 

27 



B 



D 



H 



31- 

40 37 



40 
37 

-26- 
38 
29 
33 
35 
33 
27 



46 

48 38 

^36_ 39 

41 36 



29 
42 
27 
53 
2?. 



28 
48 
33 
39 
14 



38 

U 35^ 



35 
47 
28 
41 
29 



30 
45 
33 
30 
16 



36 
41 
33 
37 
27 



28 
27 
28, 
26 



40 
35 
26 



Note. Decimal -points omitted. 



27, 
31 



K 



26 



Table 4 contains the multiple correlations for each subtest^ predicted from 
all previous subtests and shows the ordering of subtests based on the «>ultiple 
correlations. The second column of Table 4 shows the order sequence numbers 
for tie W.;. based on their ordering by the -multiple — f ^5°"/^^^^,- 
iSesrorder sequence numbers are used throughout the remainder of this report to 
Sentifv the subtests. The multiple correlations reported in Table 4 ranged f 
identify the suDt Subtest L (12) from the score on Sub- 

^e t C li to'rhfgh'of"5f /for" predicting performance on S.ubtest D (5) from 
performance on the best weighted linear combination of Subtests C. K. E, I 
(1,2,3,4). 

•The inter-subtest multiple correlations shown in Table 4 were not high 
pnnn.h to iustify applying a unidimensional adaptive testing strategy model 

A -J ToKio c^hows the raw score regression weights for the regression 

f 'ftlons l ^ZiTil, di££ere„tlai entry level achievement estimates-, 

§ for each subtest subsequenr. to the first. 
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Table 4 

Multiple Correlations Among Ordered Subtests 



Criterion 



'Predictor Subtest 





, . Subtest 


Order 


C 


K 


E 


I 


D 


G 


F 


A 


B 


J 


H 




V- - \^ 




1 


























f * 


' ' t 


2 


53 












.' 








•a 




V . ■ 

'r. ' 


. E 


3 


.48 


51^ 






















S - 

i' '•. 


■ I 


4 


42 


45 


53 














• • 






b 


5 


46 


49 


•52 


57 




















G • 


6 


41' ■ 


45 


52 


55 


55 


















F 


1 


36 


38 


44 


51 


53 


53 
















r ^" 


8 


40 


47 


49 


• 49 


51 


52 


52 










-% 




' 3.. 


9 


37 ' 


40 


44 


46 


49 


51 


51 


52 












J 


•10 


27 


31 


34 


43 


45 


46 


47 


47 


50 










H 


11 


29 


32 


39 


40 


41 


44- 


45 


45 ■ 


46 


46 








L 


-12 


22 


27 


33 


35 


35 


36 


37- 


39 


. 41 


44 


45 





Note, Decimal points omitted, 
a 

V§^lue for Rj.Q^* the multiple correlation of Subtest E, predicted from 
Subtests C and K. - ' ' , 



Comoavison of Adaptive and Conventional Tests 

Test length . The number of items §'dministered under both the adaptive and 
conventional test strategies is summarized in Table 5. Appendix Table B-3 pro- 
vides the frequency distribution of number of items administered by the adaptive 
testing strategy for each of the twelve subtests, and Table B-4 gives this fre- 
quency* distribution .for all subtests combined. 



Table 5 

Number of Items Administered in 12 Adaptive and Conventional Subtests 



Adaptive Test 



Conventional 








Range 


Percenb^ 


Subtest 


. Test 


Mean 


•■ S.D. 


• M5n 


Max 


Reduction 


1 


15 


8.73 


1.86 


4' 


13 


41.8 


2 


24 


14.12 


2.90 


4 


20 


41.2 


3 


17 


9.87 


3.38 


2 


17 


41.9 


4 


22 


12.57 


- 4.60 


2 


22 


42.9 


5 


19 


11.55 


3.58 


1 , 


18 


39.2 


6 


13 


4.70 


2.10 


1 


12 


63.8 


7 


18 


7.44 


3.21 


1 


15 


58.7 . 


8 


10 


7.07 


1.71 


1 


10 


29.3 


9 


10 


6.44' 


1:72 


,1 


9 


35.6 


10 


23 


8.42 


5.54 


1 


22 


' 63.4 


11 


12 


5.52 


2.97 


' 1 


12 


54.0 


12 


18 


5.41 


3.20 


1- 


15 


69.9 


Mean 


16>. 75 


8.49 


3.06 


1.67 


15.42 


49.3 


Test Battery 


ZOl 


101.84 


24\ 08 


27 


153 


49.3 


Computed' by 


the formula 


100- ((Mean number 


of items 


in adaptive 


test /mean 



Q number of items in conventional test)xlOO] 
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The data in Table 5 show substantial reductions in test length as a result 
of the adaptive testing strategy* For Subtest 1, 15 items were administered 
by the conventional procedure while from 4 to 13 items were administered by 
the adaptive procedure. Fifty percent of the group answered between 7 and 10 
iterasV(3ee Table B-3)* The mean number of items administered by the adaptive 
strategy in Subtest 1 was 8, 73, which represents a 41,8% reduction from the number 
of items required "by the conventional test, 

Similar results were observed for the other subtests. Reduction of number 
of items required by the adaptive test varied from a low of 29,3% for Subtest 
.8 to a high of- 69,9% for Subtest 12, in which a mean of 0,41 items was admini- 
stered by tha adaptive strategy. In Subtest 12, between 3. ari^' 7 items were 
administered. to 50% of the testees in the adaptive strategy as compared to 18 
itiBms for each testee in the conventional test. Subtest 12 had the highest 
percent reduction. In all probability, . this was attributable to the, increased 
accuracy of the test entry point from the multiple regression of the scores on 
-'the eleven prior subtests, S 

. It is interesting to note that for Subtests 5 through 12^ -the minimum number 
^of items administered hy the adaptive procedure Vas one, 'Table B-3 sliows that 
for several, of these subtests, a relatively, substantial number of t^estees was 
administered only one item, i,e,, almost 10% V ^ the total 'group for\ Subtests 6, 
ll»an^a 12, The minimum number of items administered by the adaptive strategy 
was less for tests later in the adaptive testing sequence,. This probably Re- 
sulted- from tjie increased use of prior test information for determininjg the 
initial item to be administered, 

' < . • 

Although minimum numbers of ±tem'$ were administered at relatively high fre- 
quencies by the adaptive strategy, the maximum numbers of* items -were administered 
to very fev^ testees (fable B-3),^ For Subtests 3, 4, 8, and 11 the maximum number 
of items administered by the adaptive strategy was the same as that administered 
by the conventional test; frequencies associated with these maximums were 2, 1, 
5, and 1, respectiveJLy, For the remaining eight subtests, none of the testees 
received the same number of items in the adaptive' tests as they did in the con- 
ventional test, " 

The conventional test battery consiste'd of 201 item^^ administered to all 
testees. The average number of items administered by the adaptive strate'gy 
(see Table 5) was 101,84, representing a 49,3% reduction in number of items 
administered. The median number of items administered was 103 (see Table B-4) , 
indicating a sligfit negative skew to the distribution. Fifty percent of the 
testees received between 86 and 119 items in the adaptive battery, representing 
reductions of 57,2% to 40,8% for half of the testees. As Table B-4 shows, none 
of the testees. required all the items in he adaptive administration. The 
longest adaptive battery administered required 153 items for one testee, repre- 
senting a 23,9% reductioji in test length; the shortest adaptive battery for one 
testee required ohly 27 items, representing a test lengtp reduction of 86,0%, 

Correlation Analysis - - ^ 

Table 6 shows the Pearson product-moment correlation of the Bayesian 
achievement level estimates (9) for the conventional and adaptive testing stra- 
tegies. Eleven of the twelve correlations were greater than ,90, The highest 
correlations were ,98 for Subtests 2 and 8; the lowest was .74 for Subtest 6," 



Table 6 

Correlation (r) of Bayesian Achie^j^ent Level Estimates (6) 
For the Adaptive and Conventional Testing Strategies by Subtest 



and Cronbach's 


Aipna Loettlcient 


for the Conventional Subtests 




No. 




Cronbach' s 


♦Subtest 


Items 


V 


Alpha 


1 


V 


..91 


.57 


2 


24 


.98 


.69 


3 


17 


.96 


.54 


4 


22 


.97 


.65 


5 


19 


.93 


.59 


6 


13 


.74 


.44 


7 


18 


.90- 


.50 


»8 


■ 10 


.98 


. .56 


9 


10 


.95 


.39 


10 


23 


.92 


.61 


11 


12 


.91 


.51 


•5- 12 


' •: 18 


.94 


.40 



The items contributing to the Bayesian subtest achievement level estimates 
in. the adaptive test were a subset of those used in the conventional test. 
Thus, to some extent, the magnitudes of the correlations in Table 6 were a 
function qf this part-whole relationship. This is supported by a comparison 
with the'^Alpha internal consistency estimates "for the conventional subtests 
shown in Table 6. If there were no part-whole relationship, the correlations 
between tJbe achievement level estimates would be restricted by the internal con- 
sistenci'e^s. However, all the correlations were substantially higher than the,. 
Alpha values. ^ 

If the .magnitude of the correlations of the two achievement estimates were 
primarily detecmin^d by the part-whole relationship attributable to common items 
the number of items administered in a sijbtest would bear a strong relationship 
t*o these correlations. This^wais not generally the case: One of the t\J0 highest 
correlations (^=.98) wafe observed for Subtest 8, which had only 10 items in the 
^conventional test, while Subtest 9, which also had 10 items, had an r=.95. 
Although Subtest 8 had .the smallest percentage reduction attributable to the 
adaptive administration, 20.3% (se^e Table 5), Subtest 9 had a 45.6% reduction; 
and Subtest 2.(r=.98) had a 41.7% reduction. Subtest 6, which had the lowest 
V (.74), had a 63.8% reduction attributable to adaptive testing; but the highest 
percent reduction '(69.9%) was observed for Subtest 12, for wl\ich an r = .94 was 
observed between the adaptive and conventional achievement estimates. Thus, 
these data suggest that the magnitudes of the correlation^ shown in Table 6 
were not a direct function of either the number of items in the conventional 
tests or the internal consistency of those tests. 

Infomation Analysis 

Termination criterion .001 . The first termination criterion investigated w 
termination of adaptive testing when no unadministered item providing an inform- 
ation value greater than .001 remained in the item pool for the subtest. Using 
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this termination criterion with a possible 15 parameterized items in Subtest 1, 
the mean number of items administered in the subtest was 10.55. The smallest 
number of items administered was five items for six testees; t;he largest number 
/administered was 15 items for one testee. Of the 165 testees 4.9% were admin- 
istered 10 items. ' . - ' 

Adaptive^test mean information values [1(6)] at xtvtervals of estimated, 
achievement (6) corresponding to test termination criteria of .001 and .01 are 
shown in Table 7. The range of^ estimated achievment levels was essentially the 
same for both criteria, although four*testees obtained 6 values in the interval 
2,41 to 2.60 for the .001 case. Thfese were outside the range of 6 values 
obtained in the .01 case. 

For 9 of the 14 intervals in which at least 10 testees were represented for 
both termination criteria, no significant differences were observed in mean 
intormation values. Significantly higher mean information values were observed 
for the .001 termination criterion in three intervals of 6: 0.21 to 0.40, 
0.41 to 0.60, and 0.61 to 0.80. For the remaining two intervals in which ' 
significant differences were observed, higher mean information was observed for 
the .01 termination criterion. However, the differences in mean information 
were small, with 'the largest mean difference in information .12 in the 0.21 
to 0.40 interval of §. 

The strong similarity of the profiles resulting from the twp termination 
criteria^ for Subtest 1 and the lack of any general trend in direction of the 
significant differences suggested that little was to be gained by use of the 
more stringent .001 termination criterion. Therefore, the remainder of the ^ 
analyses were conducted with the .0] termination criterion. 

Termination criterion .Cl .^ Appendix Tables B-5 through B-16 include 
mean raw values of estimated information (1(6)] at^intervals of '6 for the 
adaptive and conventional tests for ordered Subtests T through J.2. These 
values are based on mean information in test items actually adminis termed to each 
testee, using the testee's 6 at the termination of each subtest. Information 
was compute'd at intervals of .02* for 6 ranging from +3.0 to -3.0. The values 
in these tables were smbothed for plotting by the method of moving averages, 
averaging across three contiguous values with non-zero frequencies in order to* 
reduce fluctuations in the mean information values resulting from differing fre- 
quencies and/or small frequencies in the intervals of 6 (McNemar, 1969, p. 8). 

Figure 3 shows a plot of the smoothed information values "for Subtest 1; 
the smoothed values for the last subtest administered. Subtest 12 , are shown 
in" Figure 4. Appendix Figures C-1 through C-10 are plots of smoothed inform- 
ation values for the remaining subtests. For Subtest 1 thfe shape of the 
information curve for the adaptive test, as shown in Figure 3, was very similar 
to that for the conventional test. The largest differences in smoothed inform- 
ation values occurredat e=-1.4, wriere the adaptive test's smoothed^inf ormation , 
value was 2.54 and that of the conventional test was 2.47, and at 8=1.3, where 
the conventional test's information value was 1-70 and that of the adaptive 
test was 1.93. 
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Table 7 



Adaptive Test Mean Information Values [1(8)] at Estimated 
Achievement Levels (9) for Termination Criteria of .001 and .01 for Subtest 1 



9 Interval 


Termination 
" Criterion .001 


Termination 
Criterion .01 


Mean Difference 

t^.ooi^«^^-,^.oi<^^-J 


N 


1(6) S.D. 


N 


1(6; 


S.D. 


Min 


Max 


4- 

U 


df 


-3.00 


-2.80 


0 




u 










-2.7? 


-2.60 


0 




u 






t 




-2.. 59 


-2.40 


0 


- 


U 










-2.39 


-2.20 


0 




u 










-2.19 


-2.00 


0 




0 








• 


-1.99 


-1.80 


0 




0 










-1.79 


-1.60 


10 


.63 .24 


11 


. 7U 


00 


-.60 


19 


-1.59 


-1.40 


19 


1.72 .38 « 


LI 


1. OJ 


.41) 


-1.06 


39 


-1.39 


-1.20 


22 


2.76 .lo 


0 1 


Z . o/ 


n/i 

. 


-2.74** ■• 


41 


-1.19 


-1.00 


29 


2.88 .04 


23 


2 . oo 


. 04 


1.79 


50- 


-0.99 


-0.80 


2.5 


2.89 .07 




i. OD 


. Uo 


1;63 


48 


-0.79 


-0.60 


36 


3.41 .22 




J. JO 


o'/i 


90 


67 


-0.59 


-0.40 


21 


4.19 .09 




4 . i J 


1 e 
. 1 J 


1.05 


40 


■'-0.39 


-0.20 


33 


4.20 .11 


31 


4. Li. 


. 11 


■ -.36 . 


62 


-0.19 


0.00 


27 


'3.72 .19 


27 


3. 72 


.19 


.00 


52 


0.01 


0.20 


27 


3.10 .18 


JJ 




01 


1.58 


60 


0.21 


0.40" 


38 


2.55 .12 


Zb 


0 /i 1 


no 


4.33** . 


62 


0.4x 


U. oU 


28 


2.23 .09^ 


42 


2.17 


.04 


1 80** 


68 


0.61 


0.80 


23 


1.97 .06' 


14 


1.90 


.00 


4 -.'34** 


35 


0.81 


1.00 


.12 


1.81 .05 


10 


1.85 


.00 


-2.52* 


20 


1.01 


.1.20 


5 


•-1.74 .00 


13 


1.74 


.00 






1.21 


1.40 


6 


1.86 .05 


0 










1.41 


1.60 


0 




11 


2.19 


'.00 






1.61 


1.80 


4 


2.34 .00 












1.81 


2.00 


0. 














2.01 


2.20 


o' 














2.21 


2.40- 


0 , 




0 










2.41 


2.60 


'o' 




2 


5.23 


.32 






2.61 


2.80 


0^ 




0 










2.81 


3.00 


0 




0 











* p<.05 , 

p<\01 



^ • Since mean information values were available for both adaptive and 
cohv^entional tests for intervals ..f was possible to test the statis- 

tical- Nsignificance of the difference in mean estimated information between 
the adaptive and conventional strategies. This was done by computing t 
ratios bas^d on the raw information values in Tables B-5 through B-16 for 
each 0 interval containing at least ten testees'in both the adaptive and con- 
ventional strategies. Computed t-ratios were based on an independent 
groups t-test. Al^l^ough the same testees were used in determining informa- 
tion values for the two testing strategies, a repeated measures t-test could 
not be used since the shoie testees did not necessarily fall into the same 
interval of 9 on both the^aptive and conventional tests. 



Figure 3 
Smoothed Information Curves for 
Adaptive and Conventional Tests for Subtest 1 
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Contrasts on mean raw information, values provided by the adaptive and 
conventional testing strategies for Subtest 1 (see Table B-5) showed significant 
t ratios (p<.01) for the § intervals -1.39 to -1.00 and 0.41 to 1.00. The , 
adaptive test provided significantly higher mean information than the conventional 
test over the 9 intervals -1.39 to -1.20 and 0.81 to 1.00; the conventional 
test provided significantly higher mean informfiltion than the adaptive test for 
ehe intervals -1.19 to -1.00 and 0.41 to Q^^O. For the remaining 9 intervals, 
there were no statistically significant differences in. mean information. 

Similar information curves from the two testing strategies are shown for 
Subtest 12 in Figure 4. Throughout the common range of 9, the two curves were 
very similar in shape; .however, where' relatively large differences in information 
occurred, the differences favored the conventional test. The major exception 
was at 8=1.5, where the difference favored the adaptive test. For Subtest 12, 
the adaptive test provided 9 values In a wider range, with 46 of 365 testees 
obtaining J values less than -1.8 on the adaptive test; none of the testees 
obtained 6 values less than -1.8 on the conventional test. 

Contrasts on mean raw information values provided by the adaptive and 
conventional testing strategies for Subtest 12 (.see Tablo B-16) showed one 
significant t ratio (p<.05) for the 9 interval -.99 to -.80. In that interval 
the adaptive test provided significantly higher mean information than the con- ^ 
ventional test, for the remaining 9 intervals, there.were no statistically 
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Figure 4 * ' 
Smoothed Information Curvp.s for 
Adaptive and Conventional Tests for Subtest 12 
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significant differences between the estimated information values from Jthe adap- 
tive and conventional testing strategies for Subtest 12y 

As shown in Tables B-6 through B-15 for Subtests 2,^,through 11, the overall 
trend was that there were few significant differences b^^tween the estimated ^ 
information values at all 0 intervals where t-tests were' computed. The 
largest number of § intervals for which statistically ^ignificant differences-' 
in estimated infoinnation values were obtained was 6 of ja possible 14 contrasts, 
for Subtest 1 (Table B-5) ; for that subtest two of the> differences favored 
the adaptive test and four favored the conventional t^st. Two of the subtests 
(3 and 10) showed no statistically significant differences in mean estimated 
information values between conventional and adaptive testing. The general lack 
of differences in the information curves is reflected in the plots of smoothed 
information values for Subtests 2 through 11 shown in Appendix Figures C-1 
through C-10, 



Dvsoussion 

This paper has presented an adaptive testing strategy designed for use 
with the achievement test batteri^_cove^ng multiple content areas. One goal 
of the strategy* was to select and administer '^items within a subtest as a 
function of the amount of information provided by each'ite'm at each testee's * 
current^.estimated achievement level. A second goal was to us'e redundant inform- 
ation between and among subtests, by predicting a testee's performance on subsequent 
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subtests based on performance on previous subtests, to determine appropriate 
differential entry points in adaptive branching between subtests. It vjas' 
•hypothesized that attaining these goals in the design of an adaptive testing 
strategy*would result in considerable reduction in the number, of items adminis- 
tered to each testee, while sacrificing little* if any» test information com- 
pared to that obtainable by administering the entire test battery conventionally* 
Thus, the focus of this adaptive testing strategy is utilization of an existing 
item pool for an achievement test battery to efficiently measure or estimate 
each testee*s achievement level. ^ 

AppliQability of the ICC Model 

^In^;p,rder to implement the adaptive testing strategy, it is necessary to 
first ofet'ain item parameters' using the item characteristic curve (ICC) model. 
These ^ar^meters are then used' to compute an information curve for each test 
item. T\\e item information curves are used, in turn, in the process of intr||p- 
test branching. ^ 

The calibration of the ^hievement test items used in this study by the 
ICC model '^permits an opportunity .to determine the applicability o.f that model 
to achievement test data. Bejar, Weiss, and Kingsbury (1977) specifically 
evaluated^ the applicability of the model to a college classroom achievement test* 
They found that 78% of the 309 items they studied yielded ICC item parameter 
estimates. In the present study, 87% of the items submitted to Urry*s (1976) 
calibration procedure resulted in item parameter estimates acceptable by Urry*s 
criteria. 

Items were calibrated within content areas in the present study, while'^in 
the Bejar et al, study, calibration was in the context of the total set of items* 
Nevertheless, both studies shewed that the achievement test items analyzed had 
sufficiently high discrimination parameters to be useful in adaptive testing. 
In the present study, the mean discrimination (a) of all the test items was 
1.69; the corresponding value in the Bejar et al. study was 1.20. i^iiere 
was, however, a substantial difference in the Q (guessing) parameter between 
.the two studies. Although both studies used multiple-choice items with four^. 
alternative answers, the mean value of the Q parameter in the Bejar et al. 
study was .29; the mean value obtained in the present study was .48. 

There are at least two possible explanations for the higher Q parameter 
estimates in the present study.* The first, and more likely, explanation is that 
the Q parameter is poorly estimated by Urry*s program with the sample sizes 
and numbers of items used in the present study. -As Gugel, Schmidt, and Urry 
(1976) show, the Q parameter is very poorly estimated by Urry*s calibration 
program for a minimum of 50 items and 500 persons. Consequently, when c 
parameters are estimated from data on as few as 10 items from. 365 persons 
(as in the present study), it is likely that there is a wide discrepency between 
the Q parameter estimates and their true values. Thus, the high values of the 
Q parameter observed in the present study may have resulted from inadequacies 
of the parameter estimation procedure. 

A second possible explanation for the high c values is th^t some of the 
distractors in these four-choice items do not operate effectively as distractors 
If this were the case, a testee with an ''infinitely low level of 6" would be 
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able to" eliminace one or more distractors and still randomly choose between the 
remaining answers. This is contrary to the concept of the testee with an 
"infinitely low value of G'' used to interpret the c parameter. Nevertheless, 
the possibility exists that if the elements of the set of distractors are not 
all on the same achievement dimension, high values of c may be found in real test 
data. 

Intra-Subtest Bvanahinp 

The intra-subtest item selection procedure utilized in this study is a 
variation of the maximum likelihood strategies of adaptive testing (see Weiss, 
197A, pp. 62-66). Maximum likelihood adaptive testing strategies typically 
combine maximum likelihood scoring with selection of items based on maximum item 
information at the testee' s current value of §• The present strategy differs 
in that Bayesian scoring was used in place of maximum likelihood scoring; the 
maximum information item selection rule was used as in maximum likelihood adap- 
tive testing. 

In developing the intra-subtest branching scheme, consideration was given 
to using maximum likelihood procedures for scoring the items. However, given 
the requirement in maximum likelihood scoring of one correct item response and 
one incorrect item response before a 0 can be generated, it was ^determined to be 
unfeasible. Hence, the Bayesian scoring approach was used so that prior infor- 
mation coQld influen4:e subsequent achievement level estimates with as few as pne 

item administered. ^ 

* 

In general, the use of maximum likelihood scoring and Bayesian scoring on 
the same data will riot give numerically identical results. Althougti scores 
obtained from the two scoring methods are likely to be highly correlated, the 
Bayesian scoring method will result in scores which have a restricted range 
(Lord, 1976). This results from the fact that Owen's (1975) Bayesian scoring 
routine assumes a normal prior distribution of C in the population; the result 
is 9 estimates which are regressed toward the mean. The effect is a lack of 9 
estimates at the high anJ low ends of the distribution. > 

This restriction in range can nffect the present branching strategy for 
testees whose true achievement levels are very high or very low. If thiire are 
items i?hich provide information only at the extremes of the distribution (i.e., 
very difficult or very easy items of very high discrimination), it is possible 
that the regressed 9 estimate from the Bayesian strategy will terminate testing 
too soon. 

Future research should address itself to ways of eliminating ^he effects 
of regressed Bayesian 9 estimates. One possible modification of the testing 
strategy would be. to use Bayesian scoring only when .a maximum-likelihood stra- 
tegy is not feasible, i.e., after one item has been administered or uhen all 
items are answered correctly or incorrectly. When these conditions do not occur, 
maximum likelihood scoring could then be used. Another possibility would be to 
use a Bayesian scoring procedure throughout the adaptive test administration; 
at the termination of item administration within a subtest, estimated achieve- 
ment scores could then be re-computed using maximum likelihood scoring. If 
continued testing were relevant, additional items would be administered and 
scored by maximum likelihood until additional items provided no further infor- 
mation. 
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The procedure for determining en&tppointfs into later tests^ in the adaptive 
sequence from the^ data obtained from earlier tests was .based^ on a linear multiple 
regression of previously administered subtest scores* In order to implement 
this procedure, however, it was necessary to order the twelve subtests to obtain 
the^ relevant regression equations: The subtests were ordered by a procedure 
based on stepwise regression of subtest number correct scores, beginning with 
the highest correlation in the matrix, . • ^ 

Further research is necessary to determine an optimal and generalizable 
procedure for ordei^ing a set of subtests for adaptive administration in an - 
achievement test battery. The procedure used in this study may be sub-optimal 
for several reasons* First, it was based on subtest number correct scores, 
which are, in themselves, sub-optimal; thus,- an ordering of subtests based on 
methods of subtest scoring which utilize more information about the items and/ 
or testees might result in a correlation matrix with jdif f erent values.. This 
might yield a different ordering of subtests*^ . 

Second, the regression procedure used might lead to sub-optimal test entry 
points because regression estimates tend to underestimate extreme scores* When ca- 
used with more optimal scoring methods (e*g*, maximum likelihood scoring), t^his 
characteristic might require the administration of additional and unnecessary 
test items dn order to mitigate the effects of inappropriate choice of initial 

• items* Third, inai?propriate .o,rdering of tests might also result from the ten- 

' dency of stepwise proceHureV to capitalize on characteristics of the data which 
' are unique to' a given sample* Thus, a relevant question for future* research on 
procedures fdr subtest ordering is: given application of the same subtest 

* ordering procedure, whether or not different subsamples from the same population 
•/will resiat in the same subtest ordering when measured by the same test battery* 

The important, question to be answered regarding' the problem of inter-subtest 
branching is whether or not different test ordering procedures result in different 
orderings of subtests*' If the answer were affirmative, the next question would 
be what effect ordering procedures would have bpth on the number of items a'dmin- 

' i'stered and on the measurement characteristics of the resultant achievement 
estimates* .The necessity to order subtests in a test battery for adaptive 
administration bccurs only when all the intercorrelations among the subtests are 
neither zero nor. 1*0* When the subtests intercorrelate zero with each other, 
there* is. no redundant infonnation in scores on one subtest which will be useful 
in selecting. the initial item for subsequent subtests* At the other extteme, 
if all subtests intercorrelate perfectly with each other, the information obtained 
from one- is completely redundant with that obtained from any other; and no further 

. testing is necessary* 

There*is one other situation in which it may not be necessary to order the 
subtests for adaptive administration of a test battery* This would^occur when 
.all the subtests in the battery have equal correlations with each other* In 
this case the multiple correlations of each subtest with every other subtest^ 
: would b^ equal, and each subtest would provide an equal amount of redundant in- 
formation* 
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There are other procedures for ordering subtests which need. to be inves- 
tigated;." 'For example, subtes.ts might be ordered in terms of the number of items 
or thfttr reliabilities. If subtests were ordered by number of items, it would 
seem^^gical to administer the shorter tests first, based on the assumption that 
as differential^ entry points become tnore accurate due to additional redundant 
information, the longer subtests would be more. useful later in the battery. 
When ordering tests by their reliabilities, it would seem appropriate to admin- 
ister the more highly reliable subtests first: More accurate redundant infor- 
.ination would thus be obtained for selecting entry items for later tests in the 
adaptive sequence. It should be noted, however, that these two criteria for 
subtest ordering may conflict with each other, since subtest reliabilities tend 
.'to ^be- higher for longer tests. 

AlL,subtest ordering procedures discussed thus far result in a standard 
^ordering'lof subtests for all testees. However, if the philosophy of adaptive 
test administration were applied to the subtest ordering problem, it would imply 
that, the order of subtest administration should vaty for " individual testees. 
At thist stage of .research in multidimensional adaptive testing, it is not clear 
how such an individualized inter-subtest adaptive procedure would Ue implemented, 
it would seem that, to some extent, adaptive subtest selection would be based 
" on the level pf test information in the .multivariate test space at the indivi- 
dual's levels of 0 upon completion of previous subtests in a battery. However; 
specific details for the implementation of such a procedure, as well as compar- 
isons, with, alternative procedures, will have to await future research. 

CONCLUSIONS 

The real-data .simulation study in this report has supported, previous research 
which demonstrated that a typical achievement test can yield estimates of item 
difficulty and discrimination parameters useful for adaptive testing. Thus, the 
applicability of item characteristic curve theory to the measurement of achieve- 
ment has been further* corroborated. 



An important concern for adaptive testing using acliievement test batteries 
is whether or not a unidimensional model can be applied across subtests. * The 
inter-subtest multiple correlations obtained in the present study were not con- 
sidered' high enough to warrant the application of a unidimensional model across 
subtests. Instead, a multi-content branching scheme was deemed appropriate for 
this achievement test battery. 

* 

The results of this study have shown that by using this achievement test 
battery, the amount of information extracted by adaptive testing closely approx- . 
.imated that for conventional testing. The number of incidences of significant 
differences between the information curves for the conventional and adaptive 
strategies was minimal, and there were no significant differences in the majority 
of the' information values for the two testing strategies in each of the twelve: 
subtests. Given these results, an obvious question regarding the administrlation 
of acliievement test batteries is: If a computer terminal is available for test 
administration, why should test time be spent administering those test items 
which do not add to. the precision of measurement on the test battery- 
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The adaptive testing strategy described in this report provides methods 
for intra-subtest and inter-subtest branching which exclude the administratioa 

■ of unnecessary. items. The data indicate that on this achievement test 
battery the length of the battery can be reduced by 50% for the typical 
testeei In no case was it necessary to administer in the adaptive battery 

■ all (if the items included in the conventional tests. Therefore, adaptive 
testing can reduce the time spent in testing; the time saved could then 

be used by the testees for other activities, such as additi.on"al instruction. 

It is also possible that adaptive achievement testing might have positive 
# psychological advantages (e.g., Betz & Weiss, 1976), providing further 
'* beneficial effects on the psychometric characteristics of test scores. 

At th^- least, 'reduced testing time might result in more favorable attitudes 

■ ■,.of the fcestees. toward the testing process. 

In. the adaptive testing strategy implemented in this study, test length 
is a direct function of the termination criterion employed. Testing Was 
terminated within a subtest when none of .the remaining items had a 
corresponding level of item information greater than .01 (.001 for Subtest 1) 
at -the testee's current estimated .achievement level; this value was arbitrarily 
chosen. More research is needed to determine optimal termination criteria, 
i' ■ ' 

That the information curves resulting from the adaptive and conventional 
-strategies were found to be highly correspondent was to be expected from 
the way in'which items were selected "(based on item information) for the 
adaptive strategy. However, because of the inapplicability of maximum 
likelihood scoring in the ear.ly stages of item administration within a 
subtest, additional research is- needed to develop and evaluate optimal 
procedutes for item scoring. In addition, further research is needed for 
identification and evaluation of optimal procedures to order subtests for 
inter-subtest branching. 

One additional finding from the present stud^ was that the adaptive testing 
strategy consistently provided a wider range of achievement estimates than 
did the conventional strategy, using the same method for estimating 
Weiss (1973) predicted that this would occur in adaptive testing. The major 
Implication of this finding is that adaptive testing can provide more 
discriminating measurement in the upper and lower extremes..of the 
achievement continuum. 

This study has demonstrated that an adaptive testing strategy, designed 
specifically for achievement test batteries, can substantially reduce the 
number of items administered in all subtests of the battery without reducing 
the precision of subtest scores. The strategy appears to be generalizable; 
it should be applicable to a variety of test batteries in which there xs 
a fixed^nd relatively small subset of items for each subtest. Further 
research is needed to evaluate the performance of this adaptive testing 
strategy in other test batteries and in live testing situations. In . 
addition, recearch is needed to modify the adaptive testing strategy to 
identify optimal procedures for the complete individualized administration 
of an achievement test battery. 
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APPENDIX A 

' Illustration of Intra-Subtest Adaptive Branching 

< The essential characteristics of the adaptive testing strategy employed 
in this study have been described in previous sections. However, to understand ^ 
the method more completely, it is helpful to see the results of its application 
with. an actual testee. 

Figure A-1 shows estimated item information curves for six items from 
. Subtest -1. (There are a total of 15 items in Subtest 1 from which only six 
were chosen to simplify the illustration.) The height of the information curve 
K: at a given achievement level indicates the amount of information provided by the 

item. Most of the items are fairly "peaked"; that is, ,they provide information 
over a relatively narrow range of the achievement continuum. While the infor- 
mation curves overlap to some degree,* different items provide different amounts 
of information at a given point on the achievement continuum. The guiding 
principle for the adaptive procedure is t'o administer the item which provides 
the. most information §t the current achievement estimate. 

Figure A-1 

Estimated Item Information Curves for Six Items from Test 1 



2.0 . 




For a testee beginning Subtest 1, the initial achievement estimate was 
0=0 (this varied by individual for subsequent subtests); this is shown by the 
vertical dashed line in Figure A-1. Of the six items in the example, only 
three items had essentially non-zero information values at §=0; thes.e values, 
shown by the horizontal dotted lines in Figure A-1, were .90 for item 5, .48 
for item. 15, and .04 for item 12. Applying the rule that thg item selected is 
the one which provides the most information at the current 9, item 3 would be 
selected for administration. 
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* Figure. A-2 shows the revised value of e=.46 derived from the Bayeslan 
scoring routine, assuming that a correct answer was glvep to Item 5. The In-^ 
formation curve for Item 5, whlch^was already administered, Is not shown In 
Figure At the new value of 9, only Items 15 and 1^2. provide non-zero 

values of inf ortnation. Since item 15 has an infonhation value of .54 ^til item 
12 ha^ a value of .20, item 15 is selected as the second item to be administered 
to this t'estee. 



Figure A-2 

Estimated Item Information Curves for Five Items from Test 1 
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Assuming that the testee had correctly answered item 15, the^value of 6 
increased to .92'; this 1? shown in Figure A-3. At that value of 9, item 12 • 
provides .22 information and item 10 provides .V2 information. Item 12 is 
thus administered next. Assuming that item 12 was answered incorrectly, the 
9 decreased to .62, which is plotted in Figure A-4. The figure shows ..^at of 
.the three items remaining, none provides any information at the curre^ level 
of^§. Thus, there is no need for administering additional items f^om Subtest 1, 
and testing in that subtest is terminated. The achievement level estimate of 
9 =,62 is taken as the testee's score on Subtest 1, since it is based on all 
iiems providing more than non-trivial amounts of information about that testee 's 
achievement level. For inter-test branching, 9^=. 62 is used in the regression 
equation* to determine the entry point § estimate for selecting the first item 
to be administered in Subtest 2. 
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Flgure A-3 

Estimated Item Information Curves for Four Items f rom^ Test 1 
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Figure A-A 

Estimated Item Information Curves for Three Items from Test 1 
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APPENDIX B 
Supplementary Tables 
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13 


1.06 


.75 


.52 


Subten F 








1 


14 


2.17 


2.50 


.66 




1.55 


.18 


.66 


2 • 


15 


1.51 


.01 


.50 


2 


1.30 


. -.35 


-57 


3 


1'6 


1.78 


1.58 


.70 


3 


1.42 


2.43 


.51 


4 


17 


1.36 


.21 


.51 


4 


1.24 


-.02 


.55 


5 


18 


2.57 


2.08 


.62 


5 


1-76 


-1.07 


.53 


6 


Subtest D 






6 


1.62 


-53 


.55 


7 


1 


.94 


.80 


.47 


7 


1.78 


' 2.61 


.67 


8 


2 


1.40 


.49 


.51 


8 


.99 


i:o7 


.40 


9 


3 


3.36 


2.06 


.3\1 


9 


1.27 


1.98 


.53S 


10 


4 


1.03 


2.59 


.30 


10 


2.74 


-1.05 


.59p 


11 


5 


1.63? 


-.20 


.52 


11 


1.85 


.66 


.70j 


12 


6 


1.92 


-.36 


.52 


12 


1.24 


2.75 


•53^:' 


13- 


7 


2.51 


2.26 


.42 


13 


1.66 


.82 




14 





















Table B-1 

Normal Ogive Item Discrimination (a). Difficulty (6) and Guessing (c) Parameter 
Estimates f or the Twelve Subtests 



Subtest 
and. Item 



F (continued) 



1.97 
1.00 
2.11 
1.24 
1.74 

G 

^ 3.61 

1.75 
1.87 
1.19 
1.35 

1- 67 
1.24 
4.30 
1.89 
1.23 
1.84 
2.17 
1.61 

H 

2- 00 
1.87 
3.12 
2.61 
3.34 
2.01 
2.55 

.3.41 
' .94 
.86 
1-65 
1.06 

I 

1.39 
1.00 
1.89 
.77 



-.41 
2.78 
3.05 
2.78 
2.74 

-1.29 

1.71 
1.42 
.11 
.27 
.08 
2.38 
1.83 
.25 
2.60 
.91 
2.91 
2.44 

-.08 
1.38 
-.98 
1.42 
-.95 
.74 
-48 
2.62 
2-OB 
1.11 
.78 
1-52 

1.22 
1.44 
1.72 
1.15 



.59 
.48 
.71 
.44 
.49^ 

.46 

.66 
.64 
.59 
.61 
.63 
.47 
0.00 
.64 
.17 
.62 
-49 
.52. 

.41 
.45 
.65 
-37 
.53 
.38 
.36 
.54 
.37 
.32 
.45 
.35 

-34 
.25 
-43 
.44 



Subtest J 

15 \/ 

16 

17 

18 . 

19 

20 

21 

22 

23 

24 

Subtest J 
-1 
2 
3 
4 
5 
6 
7 
8 
9 

10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 



q b 

T^Tontinued) 



Subtest 
and Item 



1.18 
.90 
1.65 
1.89 
1.08 
1.64 
1.23 
1.69 
2.00 
3.50 

1.78 
2.04 
1.23 
2.94 

1.37 
1.32 
1.71 
1.86 
1.1> 
1.18 
1.51 
2.47 
1.05 

1.94 
1.62 

2.66 
1.25 
1.00 
1-21 
1.92 
1-64 
.88 



-.56 
2.00 
-.82 
.12 
.76 
-.58 
-.97 
.42 
-.97 
2.30 

2.30 
-.03 
.93 
-1.29 

.2C 
1.97 
-.20 
2.45 
1.80 
2.40 
1.48 
2.44 
1.15 

-.68 





Subtest 


K (continued) 




.31 


8 








— 


.49* 


9 


.97 


2.75 


.49 


.39 


10 











.43 


11 


:.2i 


1.83 


.59 


.53 


12 


2.00 


-.05 


.30 


.37 


13 


:i.36 


-.66 


.25 


.34 


14 








.41 


15 


.88 


.06 


.33 


.42 


16 








.29 


17 
18 


1.67 


.18 


.32 


.34 


19 


1.37 


2.c80 


.64 


.54 


20 


.75 


.44 


.35 


.61 


21 


* 1.12 


- .42 . 


.21 


.77 


27. 


1.72 


-1.00 


.43 




23 


.73 


.49 


.32 


.45 


24 


1.28 


2.68 


.64. 


.34 


25 


2.74 


.34 


.22 


.57 


26 








.21 


27 


1.66 


-.18 


.32 


.39 


28 


2.36 


-.82 


.38 


.33 


29 


1.33 


3.00 


.62 


.39 


30 








.33 


31 


.79 


.91 


.35 


.47 


32 


.85 


2.30 


.48 



.64 



Subtest 
1 



1.55 


.40 


1 2 


3.36 


2.09 


.10 






3 








2.12 


.18 


4 


1.29 


.75 


.55 


.99 


.59 


5 


1.88 


-.32 


.54 


2.51 


.37 


6 


1.68 


2.52 


.34 


1-32 


-55 


7 








1.37 


.41 


8 


1-29 


3-11 


.56 


.03 


.54 


9 


1.58 


--35 


.63 


1.87 


.37 


10 


2.40 


-1.01 


.90 






11 


1.23 


2.59 


.52 



1.44 


. -.28 


.35 


29 


2.52 


2.65 


-33 


1.11 


2.25 


.51 


Subtest 


K 






1.29 


3.06 


-57 


1 


1.75 


-1.36 


.61 


1.04 


-.32 


.49 


2 


-2.11 


1.87 


.46 


1.49 


3.09 


.64 


3 














4 


1.06 


.17 


.47 


2.06 


.47 


.44 


5. 


.79 


1.34 


.43 


1.68 


3.16 


.59 


6 


2.42 


2.71 


-57 


.89 


.73 


.41 


7 


1.55 


2.^4 


.50 



12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 



1.44 
2.41 
1.67 
2.13 
.87 
1.19 
2.01 
1.45 
1-68 
1.66 



.01 
2.23 

.53 
2.99 
2". 14 
2.59 

.44 
1-08 
3.17 
1.39 



.47 
.27 
.57 
.61 
.45 
.54 
.55 
.57 
.59 
.59 



Note . Dashed lines indicate that an item was rejected in the first phase of the item parameterization procedure. 
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Table .B-2 

-' ' ^^Rfiw Score Regression Weights (B) for Regression Equations 
Used to Determine. Differential Entry Points in Inter-Subtest Branching 

Ordered Subtest 



1- ^- , . 




1 


2 ■ 


• 3 


4 


5 ■ 


6 


7 


8 9 10 


11 


12.. 




2 


.53 
.38 


.00 

.14. 


3.97 








■ 










i '■ 




.10 


.43 


4.44 
















15: 


-.27 


.09 


.09 


.24 


4.97 














6- •• 


. .10 


.06 


.20 


.10 


.06 


.85 












'7 


, .08 


-.02 


.12 


.18 


.12 


.12 


2.38 










" 8 


.09 


.10 


.10 


-.05 


.09 


.04 


.08 


1.55 








9 • 


.05 


.02 


.07 


,02 


.10 


.13 


.00 


..08 1.70 




* 




■ 10 


-.03 


.05 


-.01 


.•20 


.09 


.16 


.16 


-.03 .36 4.05 








11 


.16 


.02 


.10 


.00. 


.03 


.16 


.09 


.06 .10 .06 


.25 






12'; 


-.01 


-.04 


.09 


.08 


-.13 


' .07 


-.07 


.23 .14 .15 


.14 


6.13 


5c; ^ 

























-\ .Note,' Regression constants (A) are on the main diagonal. 



3 ^ ' 

Table B-3 ' 

Frequency oi Number qf Items Admini stered yby .the Adaptive Testing 
Strategy and Number of Item!?* in the Conventional Subtest (*) for 
Each of the Twelve Subtests (1^365 Testees) 



No j of Ttems 












Subtest \ 












'Administered 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10' 


11 


12 


1 


b 


0 


0 


0 


1 


37 


9 


11 


6 


8 


33 


30 


2 


0 


0 


2 


12 


6 


21 


30 


3 


5 


36 


17 


44 


3 


0 


0 


8 


7 


9 


41 




4 


37 


29 


70 


40 


4 


10 


2 


11 


7 . 


2 


39 


19 


3 


14 


28 


45 


67 


,5 


29 


8 


9 


6 


9 


120 


33 


41 


7 


18 


37 


27 


6 


8 


5 


73 


7 


13 


43 


38 


,29 


22 


73 


31 


29 


V 7 


108 


0 


20 


W 


23 


36 


21 


62 


191 


28 


18 


33 


\ 8 

\ ^ 


127 
18 


14' 
6 


10 
7 


28 
18 


24 
15 


18 
4 


24 
55 


186 
21 


82 
1 


8 
8 


21 
58 


25 ' 
35 


\ 10 


8 


12 


-10 


16 


13 


2 


83 


5* 


0* 


16 


.17 


11 


\li 
k 


2 


12 


75 


33 


15 


1 


10 






11 


17 


10 


0 


2 


42 


11 


13 


3 


10 


/ 




13 


1* 


1 




0* 


33 


53 


26 


81 


0* 


5 






4 




3 






24 


'id 


29 


85 




6 






19 




7 


15 \ 




14? 


7 


51 


38 




\ 5- 






16 




3- 


16 \ 




55 


5 


36 


15 




\o 






4 




0 


17- \ 




32 


2* 


35 


2- 




6\ 






9 




0 


18 \ 




10 




31 


1 




0* 


\ 




11 




0* 


• 19' 




1 




11 


0* 








6 






20 




2 




0 












11 






21 




0 




1 










\ 


8 






22- 




0 




1* 












1 










0 

0* 
















0* 







:ERIC 



Note , 25th and 75th percentiles are underlined, 

.36 
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Table B-4 

Frequency„and Cumulative Percent of ."fotal , Number of Items Administered by 
* . the Adaptive Testing Strategy Across ail 12 Subtests (N«365 Testees) 







Cum 


No. 




Cum 


No- 




Cum 


Items 


Freq. 


Pet. 


Items 


Freq. 


Pet, 


Items'^ 


Freq. 


Pet. 




1 


1 


85 


o 
B 


% 


11/ 


1 


70 
/ Z 




1 


«1 


86 


6 


25 


1 1 Q 

llo 


5 


70 
/J 


42 


1^ 


1 


87^. 


1 


2d 


1 1 O 

119 


Q 
0 


7 Q 
/ 3 


44 


3 


2 


^ 88 


5 


27 


120 


o 
J 


lb 


47 


3 


2 


O A 

89 


4 


% 2o 


121 


o 

J 


7 7 

11 


. 51 


3 


3 


9or* * 


o 

8 


O A 

30 


too 

122 


2 


7Q 

7o 


52 


3 


4 


. » At 

91 


2 


O T 
Jl 


* TOO 

12j 




7Q 


54 


1 


4 


A n 

92 


4 


o o 


TO/. 

124 


0 


oU 


55 


2 


5 


A O 

93 




JJ 


1 0 c 

123 


4 


ftl 
oi 


57* 


2 


5 


A / 

9.4 


^6 


3j 


T 0<1 

126 




CO 

oZ 


58 


1 


6 


A e 

95 


7 


% 37 


IZ/ 


0 


o3 * 


59- 


3 


7 


A y 

96 


5 


0 Q 
JO 


1 OQ 

IZo 


O 


ft7 


60 


2 




97 




jy 


10 0 
1Z7 


c 
3 


Aft > 

OO' 


61 


2 


8 


A O 

98 


Q 

0 


41 ^ 


IJU 


c 
3 


AO 

oy 


65 


3 


8 


A A 

99 


•J 


/• ^ 
H J 


1 01 
iJl 


o 
Z 


Oft 


66 


4 


10 


100 




/■ Q 


1 00 
IJZ 




01 


68 


1 


10 


T At 

101 


8 


/.7 

4/ 


1 00 

IJJ 




00 

yz 


69 


2 


10 


iUZ 


A 


Aft 
*fO 


1 \L 


o 
Z 


73 


70 


A 


T 0 

IZ 


lUj 


0 






0 
J 




71 


2 


12 


104 


4 


51 


136 


'3 


94 


72 


1 


12 


105 


6 


52 


137 


1 


95 


73 


1 


13 


106 


8 


55 


138 


2 


95 


74 


4 


14 


107 


2 . 


55 


139 


5 


96 


75 


2 


14 


108 


11 


58 


141 


2 


97 


76 


5 


16 


109 


11 


61 


142 


2 


98 


77 


1 


16 


110 


• '6 


63 . 


144 


2' 


98 


78 




17 


. Ill 


' 6- 


64 ' 


145 . 


2 


99 


79 


2 


17' • 


112 


8 


67 


146 


1 


99 


80 


5 


19 


• 113 . 


6 


68 


147 


1 


99 


81 


1 


19 


114 


4 


&9 


• 148 


1 


99 


82 


2 ' 


19 . 


- 115 




70 • 


149 


1 


99 


83 


4 


21 


116 




72 


153 


1 


100 


84 


3 


23 















^1^ 



37 

* 

.3 



Table B-5 - 

Adaptive and Conventional Test Mean Inforaation Values [1(6)] 
and Mean Difference in Information and t Values 
at Estimated Achievement Levels (§) for Sub test 1 



6 Interval 


Adaptive Test 


Conventional 


test 


Mean Difference 




Min 


Ma;; 


N 


I (dJ 
a 


SD 


N 


1^,(6) 


SD 


fT fa\ T /fi\ 1 

[i^(6)-ig(e) J 


t 


- 

df 


t3.00 


-2.80 


0 






0 












-2.79 


-2.60 


0 






0 












-2.59 


-2.40 


6 






0 












-2.39 


•^2.20 


0 






0 












-2.19 


-2.00 


0 






' 0 












-1.99 


-1.80 


0 






0 












-1.79 


-1.60 


11 


.70 


.29 


14 


.64 


.23 


-.06 


-.58 


23 


-1.59 


-1.40 


22 


1.85 


.40 


23 


1.83 


.35 


-.02 


-.18 


43 


^1.39 


-1.20 


21 


2.87 


.04 


25 


2.73 


.13 


-.14 


-3.49** 


44 


-1.19 


-1.00 


23 


2.86 


.04 


20 


2.89 


.03 


.03 


2.75** 


41 


-0.99 


-0.80 


25 


2.86 


.06 


28 


2.89 


.06 


.03 


1.82 


51. 


-0.79 


-0.60 


33. 


3.36 


.24 


37 


3.38 


.19 


.02 


.39 


68 


-0.59 


-0.40^ 


21 


4.15 


-.15 


i9 


4.15 


.'16 


.00 


.00 


38 


-0.39 


-0.20 


31 


4.21 


.11 


24 


4.26 


.06 


.05 


2.01 


53 


-0.19 


0.00 


27 


3.72 


.19 


32 


3.75 


.23 


.03 


.54 


57 


0.01 


.0.20 


35 


3.02 


:21 


30 


3.04 


.21 


.02 


.38 


63 


0.21 


0.40 


26 


2.43 


.09 


31 


2.50 


.12 


.07 


2.45* 


55 


0.41 


0.60 


42 


2.17 


.04 


29 


2.23 


.08 


.06 


4.17** 


69 


0.61 


0.80 


'14 


1.90 


.00 


27 


1.96 


.'07 


.06 


3.19** 


39 


0'.81 


i.oo" 


•10, 


1.85 


.00 


10 


1.81 


.04 


-.04 


-3.16** 


18 


■ 1.01 


1.20 


13 


1.74 


.00 


7 


1.74 


.01 


.00 






1.21 


1.40 


0 






6 


1.85 


.01 








l.Al 


1.60 


11 


2.10 


.00 


3 


2.13 


.00 


-.06 






1.61 










0 












1.81 


2.00 








0 












2.01 


. 2.20 








0 












2.21 


2.40 








0 












2.41 


2.60 








0 












2.6i 


2.fiO 








- 0 












2.81 


3.00 








0 













*p<.05, 
**p<.01 ' 



Table B-6 ^ ' 

Adaptive and Conventional Test Mean Information Values [1(6)1 and Mean Difference' 
in Information and t Values at Estimated Achievement Levels (9) for Subtest2^ 



e 


Interval 


Ad.tptive 


Test 


Conventional 


Tebt 


Mean Difference 




Min 


Max 


N 


i„(e) 

a 


S.D. 


N 


1^.(6) 


S.D. 




\o} J c 


df 


-3.00 


-2.80 


0 






0 








■ 




-2.79 


-2.60 


0 






0 












-2.59 


-2.40 


2 


.00 


• .00 


0 












-2.39 


-2.20 


16 


.00 


.00 . 


0 












-2. 19 


-2.00 


20 


.01 


.01 


0 












-1.99 


^1. SO 


9 


.03 


.02 


0 








• 




-1.79 


-1.60 


7 


.16 


.16 


58 


.32 


.07 


. Lb 






-1.59 


-1.40 


1 


1.85 




u 


* 






- 




■fl.39 


-1.20 


20 


3.50 


.37 


0 


• 






^ * 




fl.l9 


-1.00 


40 


3.14 


.64 


0 








-2.?:2* 


50 


fo.99 


-0.80 


40 


1.60 


.42 


12 


1.32 


.20 


-.28 


f-0.79 


-0.60 . 


29 


.76 


.36 


30 


.68 


.15 


-.08 


-1.L2 


57 


/-0.59 


-0.40 


31 


.45 


vOi 

.08 


49 


-.44 




-.01 


-.79 


78 


1-0.39 


-0.20 


33 


.58 


58 


.63 


.07 


.05 


3.11** 


89 


[-0.19 


0.00 


50 


.42 


.53 


80 


.36 


.46 


-.06 


-.6tf 


128. 


0.01 


0.20 


11 


1.44 


.12 


12 


1.24 


.40 


-.20 


-1.59 


21 


0.21 


■ 0.40 


16 


1.82 


.05 


13 


1.81 


.06 


-.01 


-.49 


27 


0.41 


0.60 


15 


1.91 


.01 


23 


1.91 


.01 


.00 


' .00 


36 


0.61 


0.80 


5 


1.88 


.01 


■ 6 


1-.88- 


.02 


.00 






0.81 


1.00 


2 


1.82 


.01 


1 


1.84 




.02 






1.01 


1.20 


0 






0 












1.21 


1.40 


2 


1.73 




4 


2.64 


.41 


.91 






1.41 


1.60 


1 


.00 




12 


6.76 


1.50 • 


6.76 






1.61 


1.80 


1 


.00 




3 


11.56 


3.08 


11.56 






1.81 


2.00 


1 


.00 




1 


15.13 




15.13 






2.01 


2.20 


0 






2 


8.58 


2.82 








2.21 


2.40 


0 






1 


3.44"" 










2.41 


2.60 


1 


2.55 




0 












2.61 


2.80 


0 






0 












2.81 


3.00 


0 






0 













* p<.05 
** p<.01 



Table 

Adaptive and Conventional Test Mean Information Values [1(6)] aj^d Mean Difference 
In Information and t Values at Estimated Achievement Levels (9) for Subtest 3 



a 


IntervaJ. 


Adaptive 

N I (6) 
a 


Test 
S.D. 


Conventional 

ij I (6) 
c 


Test ■ 
S.D. 


Mean Difference 






Max 


[I (6-)-I 
c a 


A 

(6)] t 


df 




' -2.80 


0 


c 
















7Q 


-2.60 


0 




















-2. AO 


0 
















- 


-2 39 


-2.20 


12 


.00 


.00 














1Q 


-2.00 


10 


' .02 


.01 














-1 99 


-1.80 


27 


.OA 


.02 














-1.79 


-1.60 


17 


.lA 


.05 


1 


.25 






^ -.17 


29 


-1 59 


-l.AO . 


19 


.A9 


.17 


12 


.A8 


.13 


-.01 


-1 39 


-1.20 


17 


1.03 • 


.2A 


32 


I.IA 


.2A 


.11 


I453 


A7 




rl.OO 


36 


2.05 


.28 


31 


1.97 


.27 


-.08 


-1.19 


65 


-0 99 


-0. 80 


15 


2.37 


.66 


28 


2.59 


*.05 


.22 


1.77 


41 


-0 79 


-0.60 


A2 


2.A7 


.06 


AO 


2.AA ■ 


.08 


-.03 


-1.93 


80 


-0.59 


-O.AO 


21 


2.12 


.A9 


30 


2.22 


■.OA 


.10 


1.12 


A9 


-0.39 


r-0.20 


26 


2.16 


.01 


33 


- 2.16 


.01 


.00 


.00 


57 


-0.19 


0.00 


A2 


.66 


.99 


. 79 


.89 


1.06 


.23 


1.16 


119<- 


0.01 


0.20 


15 


2.00 


.55 


26 


1.98 


.58 


-.02 


-.11 


39 


0.21 


O.AO 


9 


2.28 


.05 


18 


2.28 


.05 


.00 


.00 


25 


o.Ar 


^ 0.60 


16 


2.52 


.05 


15 


2.A8 


.06 


-.OA 


-2.02 


29 


Oi61 


0.80 


A 


2.60 


.02 ' 


5 


2.65 


.02 


.05 






0.81 


1.00 


5 


2.08 


1.16 


6 


2.55 . 


.07 


.A7 






1.01 


1.20 


7 


2.29 


.12 


3 


2.28 


.06 


-.01 






1.21 


l.AO 


.6 


1;86 


.11 


3 


1.83 


.09 


• -.03 






l.Al 


1.60 


• 5 


1.22 


.69 


0 












1.61 


1.80 


1 


.00 




• 1 


- .00 




.00 






r.'81 


2.00 


1 


.00 




0 












2.01 


2.20 


- 0 






0 












2.21 


2. AO 


0 






0 












2. 41 


2.60 


0 






■ 0 






V 






2.61 


2.80 


0 






0 












2.81 


/ 3.00 


■ 1 


.00 




0 













ErJc • 40 



Table B-8 

Adaptive and Conventional Test Mean Information Values [1(6)] and Mean Difference 

in liif o ' naation and t Values at Estimated. Achievement Levels (§) for Subtest 4 

^ • ' " ' - • ^ • - 

: : § Interval Adaptive Test Conventional Test . Mean Difference 



Min 


- - « 

Max 


N 


1^(6) 


S.D. 


K 


I (9) 
c • 




c a 


V 


QX 


. ■ 
r3.pO 


-2.80 


0 


















-2.79 


-2.60 


0' 
















■ 


-2.59 


-2.40 


. 0 










O 








-2 •39. 


-2.20 


1 


.00 
















-2. is 


-2,00 


. 6 


.01 


.00 
















-ilvSO - 


17 


" .03 


.02 














-i«79 


-1.60 


12 


• 17 


.07 


3 


01 


. UO 








-1.59 


-1^40 


18 


.44 


.13 


IZ 




. 10 


• u^ 


QA 


28 


-1. 39 


-1.20 ' 


25 


1^37 


.37 


20 


!• 3o 


• JZ 


m 
. ux 




43 


-1.19 


-1.00 


25 


o eft 

2 •59 


. i/ 


Zy 


Z . OX 






.22 


52 


-0.99 


-0.80 


14, 


3.87 


.41 




3. o3 


• JO 


— . z*t 


X . oo 


36 


-0.79 


-0.60 


23 


5.08 


1. 2o 


33 


D . uo 




— . 


~ OQ 


54 


-0.59 


-0 . 40 


22 


6.31 


. 11 


2f» 


0 . 3U - 


• UO 


- ril 

— . ux 


— . 


44 


-0.3? 


-0.20 


21 


5.39 


1.30 


1/ 


J. /U 


. JZ 


. 


96 


36 


rO. 19 


0.00 


57 


.1.72 


2. 04 




!• 


1 QQ 


- 1A 

. XH 


- 40 


•136 


0.01 


0.20 


22 


3.21 


.24 


- 33* 


3.17 


.59 


-.04 


-.30- 


5.3 


0.21 


0.40 


6 


2.58 


.10 


10 


2.49 


.00 


,-.09 






O.Al 


, 0.60 


29 


2.19 


.14 


23 


2.20 


.14 


.01 


.26 


50 


6.61 


0.80 


20 


1.57 


M4 


23 


1^71 


.15 


.14 


3-.15** 


41 


0.81 


1.00 


15. 


1.31 


.09 


14 


i.4r 


.01 


.10 , 


4.13** 


27 


1\01 


^ 1.20 


5 


.84 


.04 


^ U8 


1.00 


.00 


.16 






1.21 


^1.40 


10 


.78' 


;01 


0 












1.41 


1.60 


3 


.85 


.07 


0 












1.61 


1.80 


1 


.00 




0 












i.81 


2.00 


2 


.00 


.00 




' t 










2,01 


2.20 


1 


:oo 




^ 0 












2.21 


2.40 


0 






0 












2.41 


2.60 


0 






0 












2.61 


2.80" 


0 






. 0 












2.81 


3.00 


0 






0 




< 









p<.01 



ERJC ' . '41 
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Table B-9 ' 

.Adaptive and Conventional Test. Mean Information Values [1(6)1 airi Mean Difference 
in Information and t Values at Estimated 'Achievement Levels (6) for Subtest 6 





interval 


Adaptive 




Conventional 

N I (6) 
c 


Test 
S.D. 


Mean 


Difference' 




Min . 


Max 


N 


■>! (6) 
a 


S.D. 


[i^(e)-i 


„(e)] t 


df 


-3.00 


-2.80 


0 


















-2.79 


-2.60 


0 


















-2.59 


-2.40. 


6 


.01 


.00 






- 








-2.39 


• -2.20 


4 


*' -.07 


.05 














-2.19 


-2.00 


9 


.27 


.09 • 














-1.99 


-1.80 


7 


3.31 


.79 


21 


3.48 


.69 


.17 






-1.79 


-1.60^ 


6 


5.39 


2.66 


10 


4.98 


.38 


^ -:4i 






-1.59 


-1.40 


8 


5.64 


.62 


0 












-1.39 


-1.20 


13 


3.50 


.62 


8 


. 2.56 


.24 


-.94 




42 


-1.19 


-1.00 


26 


2.04 


.11 


18 


2.02 


.11 


-.02 


-.59 


-0.99 


" -0.80 


38 


2.22 


.14 


25 


2.19 


.16 


-.03 


-.79 


61 


-0.79 


-0.60 = 


25 


2.61 


.07 


33 


2.64 


.06 


.03 


1.76 


JO 


-0.59 


-0.40 


33 


2.50 


.45 






.08 


.09 


l.Oo 


OU 


-0.39 


-0.20 


34 


2.40 


.03 


31 


2.40 


.03 


.00 


.00 


OJ 


-0.19 


0.00 


60 


1. ly 


.06 


87 


1.20 


1.26 


.01 


. Uo 




0.01 


U. ZD 


21 


2,77 


. uo 


25 


2.15' 


IvlO 


-.62 


-2.57** 


44 


0.21 


. 0.40 


14 


2.68 


.77 


27 


2.89 


.01 


.21 


1..31 


39 


0.41 


0.60 


10 


2.48 


.80 


16 


2.77 ■ 


.09 


.29 


1.45 


24 


.0.61 


0.80 


17 


2.39 


.10 


16 


2.14 


.01 


-.25 


-9.94** 


16 


0.81 


1.00 


2 ' 


1.89 


.13 


0 












1.01 


1.20 


6 


1.34 


.07 


18 


1.59 


.02 


.25 






1.21 


1.40 


8 


1.20 


.01 


0 












1.41 


1.60 


4 


1.27 


.03 


0 












1.61 


1.80 


0 






- 0 












1.81 


. 2.00 


. 1 


.00 




0 












2.01 


2.20 


1 


.00 




1 


.00 




.00 






2.21 


2.40 


1 


.00 




0 












2.41 


2.60 


0 






0 












2.61 


2.80 


0 . 






0 












2.81 


3.00 


1 


.00 




0 












** p< 


.01 





















ERIC 



42 



-37- 



I 



0^ 



- Table B--10 

Adaptive and Conventional Test Mean Information Values [1(6)] and Mean Difference 
in. Information and t Values at Estimated Achievement Levels (6) for Subtest 6 



e 


Interval 


Adaptive Test 


Conventional Test 


Mean Difference 




Mln 


nax 


N 


a 


S.D. 


N 


A 

1^(6) 
c 


S.D. 


A /*. 

[I (e)-i (G) J 

c a 


t 


df 


— J.UU 


— Z»oU . 


0 






0 












O TO 


— z • ou 


0 






0 












-2.39 




4 


. 00 


.00 


0 














o on 
— Z» ZU 


10 


.00 ^ 


.00 


0 














-Z • UU 


10 


. 00 


• 00 


0 














— ± • ou 


21 


. 02 


• 01 


0 












^1 70 




21 


• 11 


• 03 


A 


• Id 


n'i 
. U J 










—1 An 


19 ^ 


. 39 


T 0 

• 13 


0 o 
JZ 


OQ 
• Jo 


. ±± 


— • Ul 




49 






35 


• 83 


• 11 


O 


O/i 

• 


1 fi 

. ±0 


1 1 
• 11 








—1 no 


31 


!• ID 


no 
• UZ 


ofi 
ZO 


1 11 
1 • 11 


ni 
. u± 


ni 

• u± 




55 


—0 QQ 


•"U • ou 


16 


1. Oo 


• 01 


0 o 
jZ 


1 no 
1 • uy 


m 


ni 

• Ul 


0 97** 


46 




-.0 fin 

•"U • ou 


16 


1.21 


• 05 


26 


1.26 


.06 


.05 


2.79** 


40 


-0.59 


-0.40 


43 


1.55 


• 11 


42 


1.57 


.15 


.02 


.70 


83 


-0.39 


-0.20 


8 


1.78 


• 74 


35 


2.10 


.19 


.32 




ii'25 


-0.19 


0.00 


52 


1.08 


1^22 


75 


.99 


1.33 


-.09 


-.39 


0.01 


0.20 


18 


2.73 


• 99 


20 


2.93 


.69 


.20 


.73 


36 


0.21 


' 0.40 


11 


3.01 


• 07 


26 ; 


3.01 


.07 


.00 


.00 


35 


0.41 


0.60 


10 


2.51 


• 89 


14 


2.59 


.75 


.08 


.24 


22 


0.61 


0.80 


11 


2.65 


• 03 


10 


2.67 


.03 


.02 


1.53 


19 


0.81 


1.00 


4 


2.96 


• 18 


7 


2.94 


.15 


-.02 






1.01 


1.20 


4 


3.60 


• 37 


1 


3.52 




->08 






1.21 


1.40 


2 


4.57 


• 63 


3 


4.55 


.41 


-.02 






1.41 


1.60 


1 


5.70 




4 


5.78 


.31 


.08 






1.61 


1.80 


3 


6.54 


• 25 


0 












1.81 


2.00 


2 


8.10 


• 29 


0 












2.01 


2.20 


1 


.00 




0 












2.21 


2.40 


1 


.00 




0 












2.41 


2.60 


1 


.00 




0 












2.61 


2.80 


0 






1 


10.57 










2.81 


3.00 


0 






0 













* p<.05 
** p<.01 
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Table B-11 

Adaptive and Conventional Test Mean Information Values [1(6)1 and Mean Difference 
in' Information and t Values at Estimated Achievement Levels (6) for Subte.8t_7 — 



A"' 

. 6 Ihterval 


Adaptive Test 


Conventional Test 


Mean Difference 




Mln 


Max 


N 


I (6) 


S.D. 


N 


I (6) 
c 


S.D. 


[I (6)-! (G)] 
c a 


t 


df 






0 






0 
















0 






0 














-9 AO 


0 






0 














-2.20 


9 


.00 


.00 


0 












— 9 IQ 


-9 00 


31 


.00 


.00 


0 














-1.80 


18 


.00 


.00 


0 












-1.79 


-1.60 


6 


.01 


.01 


0 








.00 


31 


-1.59- \ 
.-1.'39 ^, 


-i.40 


19 


.09 


.07 


14 


.09 


.01 


.00 


-1.20 


15 


.80 


.29 


35 


.62 


.20 


-.18 


•2.54* 


48 


' -1.19 


-1.00 


'34 


2.42 


.71 


38 


2.14 


.39 


. -.28 


•2.10 


70 


-0.99 


-0.80 


26 


4.15 


.21 


0 








2.59* 


57 


-0.79 


-0.60 


24 


3.15 


.40 


35 


3.42 


.39 


.27 


-0.59 


-0.40 


47 


2.12 


.29 


32 


2.13 


.33 


.01 


.14 


77 


-0.39 


-0.20 


17 


1.55 


.04 


43 


1.55 


.04 


.00 


.00 


58 


-0.19 


0.00 


40 


1.00 


4.01 


90 


.78 


.•86 


-.22 


-.50 


128 


0.01 


0.20 


9 


.2.28 




21 


2.17 


.57 


-.11 


-.56 


28 


0.21 


0.40 


16 


2.95 


.85 


11 


3.33 


.32 


.38 


1.41 


25 


0.41 


0.60 


10 


4.53 


.26 


16 


4.56 


.20 


.03 


.33 


24 


.0.61 


0.80 


8 


4.32 


1.74 


12 


4.94 


.03 


.62 






' 0.81 


1.00 


9 


4.22 


1.59 


6 


.4.67 


.03 


.45 






1.01 


1.20 


2 


4.67 


.03 


4 


4.66 


.04 


-.01 






1.21 


1.40 


2 


5.23 


.02 


2 


5.27 


.10 


.04 






1.41 


1.60 


5 


5.28 


.io 




5.29 


.10 


.01 






1.61 


1.80 


1 


4.30 




^0 






.59 






1.81 


2.00 


2 


2.96 


.61 


. 2 


3.55 


.00 






2.01 


2.20 


1 


2.40 




1 


1.87 










2.21 


2.40 


1 


.00 




0 












2.41 


2.60 


1 


.00 




0 












2.61 


2.80 


1 


.00 




0 












2.81 


3.00 


1 


2.19 




0 










• 



* p<.05 



Table B-12 ^ , 

Adaptive and Conventional Test Mean Information. Values [1(0)1 ,aRd Mean Difference 
- ^ and t Values at Estimated Achievement Levels 1(6) for Subtest 8 



i n Information 

9 Interval ^aptive Test 



Mln 



tMax 



N 



I (6) 
a 



Conventional Test 
S.D. N 



Mean Difference 



I (8) 
c 



s.D. [i^(e)ji^(e)] 



df 



-3.00 
-2.79 
-2.59 
-2.39 
-^2.19 
-1.99 
-1.79 
-1.59 
-1.39 
-1.19 
-0.99 
-0.79' 
-0.59 
-0.39 
-0.19 
0.01 
0.21 
O.Al 
0.61 

0. 81 
1.01 
1.21 

1. Al 
1.61 
1.81 
2.01 
2.21 

2. A1 
2.61 
2^81 



-2,80 
-2.60 
-2. AO 
-2:20 
-2.00 
-1.80 
-1.60 
-l.AO 
-1.20 
-1.00 
-0.80 
-0.60 
-O.AO 
-0.20 
0.00 
0.20 
O.AO 
0.60 

0. 80 
1.00 
1.20 

1. AO 
1.60 
1.80 
2.00 
2.20 

2. AO 
2.60 
2.80 

3;.oo 



0 
0 
0 
8 
.9 
19 
32 
61 
17 
38 
26 
25 
10 
18 
Al 
10 
13 
- 3 
7 
6 
3 
0 
2 
1 
1 
1 
0 
1 
1 
1 



.00 

.00 

.00 

.01 

.03 
-.11 
■ .31 

.5A 

.89 
1.26 
1.76 

.58 
2.08 
2.56 
1.88 
2.78 
1.7A-. 
2.27 

2.23 
A. 35 
.00 
9.71 

.00 
.00 

,00 



.00" 
.00 
.00 
.01 
.01 
.OA 
.05 
.08 
.09 
.16 
.12 

\92 
.73 
.07 

1.62 
.07 

1.35 
.06 

.16 



0 
0 
0 
.0 
1 
0 
0 
A 
26 
29 
A3 
59 
• 3A 
37 
70 
26 
10 
11 
2 
6 
A 
2 
1 
0 
0 
0 
0 
0 
0 
0 



.00 



. .05 


.01 


.02 


.lA . 


.03 


.03 


.29 


.07 . 


-.02 


.5A 


.08 


° .00 


.8A 


.10 


-.05 


1.26 


.15 


.00 


1.72 


.13 


-.OA 


.63 


.97 


.05 


2.2A 


.A6 


.16 




.08 


.11 


2.83 


.OA 


.95 


2.82 


.06 


.OA 


2.58 


.10 


.8A 


2.35 


.05 


.08 


2.18 


.01 




2.18 




.05 



2. .81** 


Al 


-1.36 


65 


' .00 


"67 


-2.16 


82 


.00 


A2 


-1.10 


53 


.27 


109 


.79 


'3A 


3.51** 


21 



X 



45 



.Table B-13 

Adaptive and Conventional Test Mean Information Values [t(6)] and Mean Difference 
: ! In Infoncatlon and t Values at Estimated Achievement Levels (9) for Subtest 9 



§ Interval 


Adaptive Test 


Conventional 


Test 


Mean Difference 




Miri 


Max 


N 


A 

1^(6) 


S.D. 


N 


A 

I (6) 


S*D* 


^ A 

[I (9)-I (9)] 


t 


at 


tS.OO 


-2.80 


0 


















~2;79 


-2.60 


0 


















-2.59 


.-2.40 


0 


















t2.39 


-r2.20 


^'o 


















-2.19 


-2.00 


1 


.00 
















-1.99 


-1.80 


0 








• 










-1.79 


-1.60 


12 


.64 


.34 


14 


.64 


• Z J 


.00 


.00 


OA 


-1.59 


-1.40 


22 


1.85 


.40 


23 


1.83 


• JD 


-.02 


-.18 




-1.39 


-1.20 


20 


2.86 


.04 


24 


2.73 


1 Q 


. -.13 


-3.16** 


A9 

**z 


.-1.19 


-1.00 


24 


2.74 


.59 


20 


2.89 


•Vj 


.15 


1.13 


AO 


-6.99 


-0.,80 


25 


2.86 


.06 


28 


2.89 


• Uo 


.03 


1.82 




-0.7.9 


-0.60 


31 


3.35 


.24 


34 


3.39 


on 


'.04 


.73 


0 J 


-0.59 


-0.40 


20 


4.14 


.15 


18 


4.14 


• lo 


.00 


.00 


JO 


-0.39 


-0.20 


29 


4.21 


.11 


22 


4.25 


.07. 


.04 


1.49^ 


49 


-0.19 


0.00 


50 


1.67 


1.87 


75 


1.36 


1.83 


-.31 


-.92 


123 


0.01 


0.20 


30 


3.03 


.21 


27 


2.90 


.62 


-.13 . 


-1.08 


55 


0.21 


0.40 


22 


-.2.32 


.53 . 


24 


2.50 


.12 


.18 


1.62 


44 


0.41 


' 0.60 


33 


2.17 


■ .04 


23 


2.23 


.08 


■ .06 


3.70** 


54 


0.61 


0.80 


9 


1.69 


.'63 


19 


1.97 


.07 


.28 






.0.81 


. 1.00 


8 


1.85 


.00 


5 


1.82 


.05 


-.03- 






1.01 


1.20 


7 


1.49 


.66 


4 


1.74 


.00 


.25 






1.21 


1.40 


0 






2 


1.85 


,02 








1.41 


1.60 


6 


2.19 


.00 


2 


2.13 


.00' 


-.06 






1.61 


1.80 


0 


















1.81 


2.00 


2 


.00 


.00 














2.01 


2.20 


0 


















2.21 


2.40 


0 


















2.41 


2.60 


0 


















2.61 


2.80 


1 


.00 
















2.81 • 


3.00 


2 


.00 


.00 















** p<.01 
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Table B-14 

Adaptive and conventional' Test Mean Information Values [!(§)] and Mean Difference 
In Inforinatlon and t Values at Estimated Achi evement Levels (Q)- f.or Subtest XO 

Mean Difference 



9 Interval 


Adaptive Test 


Mln 


Wax ' 


.N 


I (§) 


S.D. 


-■-3.00 


-2.80 


0 






-2.79 


-2.60 


0 






-2.59 


■ -2.40 


0 






-2.39 


-2.20 


1 


.00 




-2.19 


-2.00 


0 






-1.99- 


-1.80 , 


11 


.21 


.08 


-1.79 


-1.60 


11 


.51 


.15 


-1.59 


-1.40 


15 


.87 


.28 


-1.39 


-1.20 


21 


2.07 


• 32 


-1.19 


-1.00 


15 


3.39 


.54 


-0.99 


-0.80 


21 


4.84 


1.20 


-0.79 


-0.60 


24 


6.-79 


.29 


-0.59 


-0.40 


26 


7.25 


.04 


-0.39 


-0.20 


30 


7.09 


.04 


-0.19 


0.00 


65 


4.02 


3.64 


0.01 


0.20 


22 


8.05 


.27 


0.21 


0.40 


21 


8.56 


.05 


0.41' 


0.60 


15 


7.02 


1.98 


0.61 


0.80 


20 


5.61 


.65 


0.81 


1.00 


10 


3.89 


.48 


0.01 


1.20 


11 


2.69 


.20 


1.21 


1.40 


10 


1.94 


.69 


1.41 


1.60 


2 


2.14 


.11 


1.61 


1.80 


1 


.30 




1.81 


2.00 


0 






2.01 


2.20 


U 






2.21 


2.40 


0 






2.41 


2.60 


0 






2.-61 


2.80 


0 






2.81 


3.00 


3 


.00 


.00 



Conventional Test _ 

N 1^(6) S.D. [i^(§)-i3(e)] 



df 



0 
0 
0 
0 
0 
3 
11 
8 
16 
19 
28 
21 
29 
32 
83 
28 
23 
14 
18 
15 
11 
3 
3 



.30 
-.47 
1.18 
1.89 
3.25 
5.23 
"6.94 
7.24 
7.07 
3.24 
7.43 
8.59 
7.68 
5.66 
3.88 
2.09 
2.14 
2.08 



.03 
-.09 
.17 
.29 
.51 
.66 
.25 
.04 
.04 
3.64 
2.12 
.06 
.44 
.64 
.46 
1.05 
.06 
' .01 



.09 
.04 
.31 
.18 
.14 
.39 
.15 
.01 
.02 
.78 
-.62 
.03 
.66 
.05 
-.01 
-.60 
.20 
-.06 



-.76 

-1.76 
-.78 
1.45 
1.85 
-.93 
-1.97 
-1.29 
-1.36 
1.79 
1.22 
.24 
-.05 
-1.86 



20 

35 
32 
47 
43 
53 
60 
146 
48 
42 
27- 
36 
23 
20 



ERIC 



47 
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Table B-15 " 

Adaptive and Conventional Test Mean Information Values [1(6)] and Mean Difference 
_ja^nfonnatlon and t Values at Estimated Achievement Levels (§) for Subtest 11 



f.: . ^ ii 


-j.nuervax 


- Adaptive Test 


Conventional 


Test 


Mean Difference 




L, ^ 

i , — : — ^ 


Max 


N 


I (6) 
a 


S.D. 


N 


I (6) 

C 


S.D. 


[I (§)-! (6)] 
c a 


t 


df 


? . ' -3.00 


-2.80 


0 






0 












f .-2.79 


-2.60 


0 






0 












; , -2.59 


-2.40 


2 


^ .04 


.00 


0 












-2.39 


-2.20 


4 


.03 


.03 


0 












• -2.19 


-2.00 


16 


.13 


.03 


0 












j : -1.99 


-1.80 


. 11 


.25 


.05 


0 












-1.79 


-1.60 


.lA 


.44 


.15 . 


0 












i -1.59 


-1.40 


21 


.74 


.09 


6 


.76 


".08 


.02 






-1.39 


-1.20 


22 


i.67 


' .29 


18 


1.13 


.12 


-.54 


-7.39** 


38 


-1.19 


-1.00 


36 


1.69 


.22 


31 


1.91 


.13 


.22 


4.88** 


65 


-0.99 


-0.80 


22 


2.61 


.28 


34" 


2.69 


.30 


.08 


1. 00 


54 


': -0.79 


-0.60 










J. 57 


.27 


. 17 


1.47 


75 


. -0.59 


-0.40 


33 


4.15 


.12 


32 


4.23 


.09 


.08 


3.03** 


63 


—0.39 


-0. 20 


25 


4.27 


.06 


50 


4.28 


.06 


.01 


.68 


73 


- -0.19 


0.00 


54 


1.89 


1.95 


63 


1.10 


1.75 


-.79 


-2.31* 


115 


: • 0.01 


0.20 


19 


3.30 


.59 


32 


3.09 


1.02 


-.21 


-.82 


49 


0.21 


0.40 


12 


3.19 


.01 


16 


3.20 


.02 


.01 


1.59 


26 


i 0.41 


0.60 


11 


3.30 


.05 


11 


3.27 


.05 


-.03 


-1.41 


20 


: 0.61 


0.80 


8 


2.95 


1.19 


11 


3.39 


.02 


.44 






0.81 


1.00 


9 


3 . 18 


.09 


1 


3.33 




.15 






1.01 


1.20 


1 


.00 




2 


2.67 


.04 


2.67 






1.21 


1.40 


3 


2.13 


.03 


2 


2.28 


.12 


.15 






1.41 


1.60 


2 


1.98 


.01 


1 


2.00 




.02 






, 1.61 


1.80 


1 


2.00 




0 












1.81 


2.00 


0 






1 


2.06 










2.01 


2.20 


1 


2.71 




. 0 












2.21 


2.40 


0 






0 












2.41 


2.60 


0 






0 












2.61 


2.80 


0 






0 












2.81 


3.00 


0 






0 













* p<.05 
** p<.01 
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Table B-16 

Adaptive and Conventional Test Mean Information Values [1(9)] and Mean Difference 
■ in Information and t Values at Estimated Achievement Levels (9) for Subtest 11 



A 

9 Interval 


Adaptive 


Test 


' Conventional Test 


Mean Difference 


* 


Mln 


Max. 


N 


A 


O mU m 


N 


A 

1^(9) 


S.D. 


A A 


t 


df 


-3.00 


-2.80 


0 






0 












-=2.79 


-2.60 


0 






0 












-2.^59 


-2.40 


11 


.11 




0 








• 




-2.39 .. 


-2.20 


7 


.04 


m 


0 












-2.19 


-2.00 


15 


.06 




0 












-1.99 


-1.80 


13 


.20 




0 












-1.79 


-1.60 


12 


!,41 


.0/ 


1 


.53 






• /I 


23 


-1.59 


-1.40 


15 


.88 


OQ 

• Zo 


10 


.95 


.17 


• 0/ 


-1.39 


-1.20 


23 


1.73 


OA 


21 


1.81 


.26 




1 . uo 


42 


.-1.19 


-1.00 


23 


2.63 


• O/ 


24 


2.81 


.32 


.18 


1. lo 


45 


-0.99 


-0.80 


17 


4.04 


O/i 

• 


31 


3.86 


.28 


lo 


— Z. £.H^ 


46 


-0.79 


-0.60 


27 


4.57 


1 /. 


32 


4.56 


.12 


-.01 


— « JU 


57 


-0.59 


-0.40 


33 


4.64 


• O J 


44 


4.80 


.01 


.16 


1. Zo 


75 


— u» 






H • 1 J 


no 


35 


4.76 


.02 


.01 


1.86 


56 


-0.19 


0.00 


49 


2.07 


2.37 


80 


2.03 


2.37 


-.04 


-.09 


127 


0.01 


0.20 


19 


4.97 


.09 


24 


4.36 


1.69 


-.61 


-1.57 


41 


0.21 


0.40 


16 


5.23 


.05' 


16 


5.23 


.06 


.00 


.00 


30 


0.41 


0.60 


10 


5.25 


.05 


12 


5.27 


.04 


.02 ' 


1.04 


20 


.. 0.61 


0.80 


11 


4.84 


.17 


10 


4.89 


.15 


.05 


.71 


19 


0.81 


1.00 


10 


3.35 


1.77 


9 


4.29 


.16 


.94 






. 1.01 


1.20 


4 


3.73 


.04 


7 


3.60 


.09 


-.13 






1.21 


1.40 


7 


2.89 


1.28 


5 


5.36 


.05 


.47 






1.41 


1.60 


4 


3.30 


.00 


1 


3.32 




.02 






1.61 


1.80' 


1 


3.32 




0 












1.81 


2.00 


1 


3.69 




0 












2.01 


2.20 


0 






0 












2.21 


2.40 


0 






1 


6.66 










2.41 


2.60 


1 


6.67 




0 












2.61 


2.80 


0 






0 












2.81 


3.00 


0 






1 


2.26 










* p<.05 



49 
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APPENDTX C 
Supplementary Figures - 



Figure C-1 
Smoothed Information Curves for 
Adaptive and Conventional Tests for fiubtest 2 
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Figure C-2 
Smoothed Information Curves for 
Adaptive and Conventional Tests for Subtest 3 
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Figure C-3 
Smoothed Information Curves for 
Adaptive and Conventional Tests for Subtest 4 
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Figure C-4 
Smoothed Information Curves for 
Adaptive and Conventional Tests for Subtest 5 
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Figujre C-5 
* Smoothed Information Curves for 
Adaptive and Conventional Tests for Subtest 6 
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Figure C-6 
Smoothed Information Curves for 
Adaptive and Conventional Tests for Subtest 7 
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Figure^ C-7 
• Smoothed Information Curves for . 
Adaptive and Conventional Tests for Subtest 8 
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Figure C-8 
- Smoothed Information Curves for 
Adaptive and Conventional Tests for Subtest 9 
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Figure C-9 
♦ Smoothed Information Curves for 
Adaptive, and Conventional Tests for Subtest 10 
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Figure C-iO 
Smoothed Information Curves for 
Adaptive and Conventional Tests for Subtest 11 
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